00000001:02000400:3.0F:1788529541.936145:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788529568.731870:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788529570.757715:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 479 MB/s 00000001:01000000:0.0F:1788529571.007282:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 591 MB/s 00000001:01000000:3.0:1788529571.257618:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3259 MB/s 00000020:02000000:2.0F:1788529572.291860:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_5_ge0db421 00000400:02000000:3.0:1788529573.747206:0:3284:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.152@tcp [8/256/0/180] 00008000:02000000:3.0:1788529578.301048:0:3433:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788529639.151835:0:5236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788529652.989088:0:5810:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788529652.989096:0:5810:0:(obd_mount.c:928:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788529652.989233:0:5810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000480f5b3c 00000080:02000400:3.0:1788529652.989243:0:5810:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788529652.996678:0:5810:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788529652.996692:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788529652.997461:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000482b43b6) 00000020:00000080:3.0:1788529652.997485:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788529653.024475:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788529653.025323:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788529653.052728:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788529653.052782:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788529653.052805:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788529653.052861:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788529653.052888:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788529653.053533:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788529653.053684:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788529653.053695:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18ac2e 00000020:01000004:3.0:1788529653.053703:0:5810:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788529653.053710:0:5810:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788529653.053714:0:5810:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000480f5b3c from MGS 00000020:01000004:3.0:1788529653.053719:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788529653.053731:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000657adb6d) 00000020:00000080:3.0:1788529653.053741:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788529653.053805:0:5810:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000480f5b3c from MGS, refs=2 00080000:01000000:3.0:1788529653.053811:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788529653.053816:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18ac3c 00000100:00100000:3.0:1788529653.054151:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788529653.054305:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788529653.054311:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788529653.055180:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788529653.055189:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788529653.056236:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529653.056494:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788529653.056500:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788529653.057505:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788529653.057514:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788529653.058200:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788529653.058208:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788529653.059174:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529653.059178:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529653.059180:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529653.059628:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529653.059631:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529653.059632:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529653.060643:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788529653.066172:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788529653.310271:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3003 MB/s 00000001:01000000:0.0:1788529653.561032:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2980 MB/s 00000001:01000000:1.0:1788529653.811092:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 407 MB/s 00000001:01000000:2.0:1788529654.061194:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 611 MB/s 00080000:10000000:2.0:1788529654.076287:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788529654.093938:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788529654.108183:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788529654.108210:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788529654.108213:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788529654.126511:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788529654.126609:0:5810:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788529654.126682:0:5810:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788529654.127013:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788529654.127040:0:5810:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788529654.127576:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529654.127777:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788529654.127785:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788529654.130066:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788529654.130079:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788529654.130683:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788529654.130691:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788529654.131607:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788529654.131628:0:5810:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:3.0:1788529654.131630:0:5810:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788529654.131677:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:3.0:1788529654.131691:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (0000000058a0b490) 00000020:00000080:3.0:1788529654.131710:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788529654.131830:0:5810:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b50a3ae7@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1788529654.132037:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:3.0:1788529654.132044:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788529654.136733:0:5825:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788529654.141952:0:5827:0:(mgc_request.c:893:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788529654.142006:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid 72cd2bce-e770-4df8-80b5-9001b91d336b) 00000020:00000080:2.0:1788529654.142033:0:5810:0:(genops.c:1385:class_connect()) connect: client 72cd2bce-e770-4df8-80b5-9001b91d336b, cookie 0xaa46022e3f18ac4a 00000100:00080000:2.0:1788529654.142047:0:5810:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788529654.142053:0:5810:0:(import.c:665:import_select_connection()) MGC192.168.201.152@tcp: import 00000000b50a3ae7 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529654.142102:0:5810:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001b49aea2 x1875409185538176/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788529654.146147:0:5810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 72cd2bce-e770-4df8-80b5-9001b91d336b->MGS 00000020:01000004:2.0:1788529654.146184:0:5810:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788529654.146190:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788529654.146217:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006d2616f9) 00000020:00000080:2.0:1788529654.146238:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788529654.146815:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b49aea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72cd2bce-e770-4df8-80b5-9001b91d336b:3299:1875409185538176:0@lo:250: 00000100:00100000:1.0:1788529654.146935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529654.147006:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538176 00000100:00100000:1.0:1788529654.147015:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538176 00000100:00100000:1.0:1788529654.147056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529654.147063:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fb3bda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875409185538176:12345-0@lo:250: 00010000:00080000:1.0:1788529654.147088:0:5822:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 72cd2bce-e770-4df8-80b5-9001b91d336b@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1788529654.147112:0:5822:0:(genops.c:1385:class_connect()) connect: client 72cd2bce-e770-4df8-80b5-9001b91d336b, cookie 0xaa46022e3f18ac58 00000100:00080000:1.0:1788529654.147231:0:5822:0:(import.c:65:import_set_state_nolock()) 00000000cf22dc13 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788529654.147279:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fb3bda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:3299:x1875409185538176:12345-0@lo:250: Request processed in 215us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529654.147286:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529654.148093:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788529654.148105:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:1.0:1788529654.148114:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788529654.148119:0:3299:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788529654.148122:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000b50a3ae7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788529654.148126:0:3299:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788529654.148135:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788529654.148140:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b49aea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72cd2bce-e770-4df8-80b5-9001b91d336b:3299:1875409185538176:0@lo:250: 00000100:00100000:2.0:1788529654.165350:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529654.169714:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788529654.169724:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788529654.176974:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788529654.176987:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788529654.177450:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788529654.177458:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788529654.179523:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529654.179716:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788529654.179723:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788529654.180649:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788529654.180661:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788529654.262064:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529654.262374:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788529654.262381:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788529654.268972:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788529654.268987:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788529654.270416:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529654.270618:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788529654.270630:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788529654.271641:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788529654.271650:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788529654.273188:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529654.273377:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788529654.273382:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788529654.276695:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788529654.276719:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788529654.278435:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788529654.278645:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788529654.278651:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788529654.281294:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788529654.281307:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788529654.358124:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529654.358356:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788529654.358363:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788529654.381613:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788529654.381632:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788529654.396469:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788529654.396487:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788529654.400797:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788529654.400861:0:5810:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788529654.400866:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788529654.400868:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529654.400869:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529654.400871:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529654.400872:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529654.400873:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529654.400875:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529654.400876:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529654.400877:0:5810:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529654.400878:0:5810:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529654.400880:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529654.400881:0:5810:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529654.400884:0:5810:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788529654.400886:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788529654.400888:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529654.400889:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529654.400890:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529654.400890:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529654.400910:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529654.400912:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529654.400913:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529654.400914:0:5810:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529654.400915:0:5810:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529654.400916:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529654.400917:0:5810:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529654.400965:0:5810:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788529654.400985:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538304:0@lo:253: 00000100:00100000:3.0:1788529654.401071:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.401121:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ccdc9f0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529654.401259:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538304 00000100:00100000:0.0:1788529654.401268:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538304 00000100:00100000:0.0:1788529654.401326:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529654.401333:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019a478b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5810:x1875409185538304:12345-0@lo:253: 20000000:01000000:0.0:1788529654.401392:0:5824:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788529654.401399:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788529654.410968:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788529654.411056:0:5824:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788529654.413210:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529654.418805:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788529654.419568:0:5824:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788529654.419573:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788529654.419580:0:5824:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788529654.419583:0:5824:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788529654.419597:0:5824:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788529654.419876:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529654.420177:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788529654.420191:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788529654.420239:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788529654.420296:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788529654.420335:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788529654.420607:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788529654.420617:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788529654.420664:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788529654.420671:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788529654.420699:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788529654.420706:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788529654.420736:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788529654.420798:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788529654.420888:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788529654.421120:0:5824:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788529654.421144:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529654.421355:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788529654.421382:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788529654.421418:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788529654.421451:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788529654.421496:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788529654.421506:0:5824:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788529654.421578:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788529654.421586:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788529654.421649:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788529654.421686:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788529654.421719:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788529654.421731:0:5824:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788529654.423616:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788529654.423643:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788529654.423716:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788529654.423767:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788529654.424316:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788529654.424678:0:5824:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788529654.424686:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788529654.441792:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788529654.442287:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788529654.442314:0:5824:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.152@tcp for mdt 20000000:01000000:0.0:1788529654.442318:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788529654.442371:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788529654.442379:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788529654.442408:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788529654.442414:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:0.0:1788529654.442454:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788529654.442465:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788529654.442496:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788529654.442528:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788529654.442586:0:5824:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788529654.442590:0:5824:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788529654.442594:0:5824:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788529654.442600:0:5824:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788529654.445889:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788529654.452098:0:5824:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788529654.473415:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788529654.473452:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788529654.473500:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788529654.473514:0:5824:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788529654.473521:0:5824:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788529654.473523:0:5824:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788529654.473533:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788529654.473535:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788529654.473557:0:5824:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788529654.473559:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788529654.475714:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788529654.476511:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788529654.476559:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788529654.476592:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788529654.476604:0:5824:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788529654.476606:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788529654.477281:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788529654.477597:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788529654.477650:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788529654.477710:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1788529654.477724:0:5824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788529654.477726:0:5824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788529654.477734:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788529654.477766:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477783:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477793:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477798:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477804:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477810:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477827:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f5ebabe already unused, calling callback (0000000099e374c0) 00010000:00010000:0.0:1788529654.477831:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477838:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477850:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477867:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.477873:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788529654.477923:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788529654.721676:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019a478b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5810:x1875409185538304:12345-0@lo:253: Request processed in 320336us (320598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529654.721690:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529654.721814:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538304:0@lo:253: 10000000:01000000:3.0:1788529654.721831:0:5810:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788529654.721834:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529654.721835:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529654.721837:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529654.721838:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788529654.721839:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529654.721841:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529654.721842:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529654.721843:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529654.721844:0:5810:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788529654.721846:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529654.721847:0:5810:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788529654.721864:0:5810:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000480f5b3c from lustre-MDT0000 10000000:01000000:3.0:1788529654.721888:0:5810:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788529654.721891:0:5810:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788529654.721922:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cabc80f0000 10000000:01000000:3.0:1788529654.721928:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529654.721944:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabc80f0000 from 1 10000000:01000000:3.0:1788529654.721947:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788529654.721983:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.722010:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.722019:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529654.722037:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538432:0@lo:101: 00000100:00100000:3.0:1788529654.722074:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.722119:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d895fc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529654.722191:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538432 00000100:00100000:0.0:1788529654.722198:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538432 00000100:00100000:0.0:1788529654.722240:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529654.722247:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d14dca6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5810:x1875409185538432:12345-0@lo:101: 00010000:00010000:0.0:1788529654.722258:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529654.722268:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ac66 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.722288:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.722295:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f5ebabe/0xaa46022e3f18ac6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.722303:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f5ebabe, rc 0) 00000100:00100000:0.0:1788529654.722337:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d14dca6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+6:5810:x1875409185538432:12345-0@lo:101: Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529654.722343:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529654.722685:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538432:0@lo:101: 00010000:00010000:3.0:1788529654.722697:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.722715:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529654.722755:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538560:0@lo:501: 00000100:00100000:3.0:1788529654.722776:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.722795:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d895fc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529654.722888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538560 00000100:00100000:0.0:1788529654.722915:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538560 00000100:00100000:0.0:1788529654.722935:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788529654.722941:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca776435 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+6:5810:x1875409185538560:12345-0@lo:501: 00000100:00100000:0.0:1788529654.723151:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca776435 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+6:5810:x1875409185538560:12345-0@lo:501: Request processed in 210us (373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788529654.723158:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529654.725944:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538560:0@lo:501: 10000000:01000000:3.0:1788529654.725977:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529654.725993:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.726004:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000a6241784/0xaa46022e3f18ac66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529654.726034:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8cabc80f0000 10000000:01000000:3.0:1788529654.726041:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788529654.726071:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8cabc80f0000 10000000:01000000:3.0:1788529654.726075:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788529654.726087:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff8cabc80f0000 from 1 10000000:01000000:3.0:1788529654.726090:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788529654.726126:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.726134:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.726143:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529654.726160:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538688:0@lo:101: 00000100:00100000:3.0:1788529654.726216:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.726251:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d895fc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529654.726530:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538688 00000100:00100000:0.0:1788529654.726538:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538688 00000100:00100000:0.0:1788529654.726583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788529654.726591:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000866fc212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+6:5810:x1875409185538688:12345-0@lo:101: 00010000:00010000:0.0:1788529654.726603:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529654.726615:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030d4cc83/0xaa46022e3f18ac7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ac74 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.726635:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030d4cc83/0xaa46022e3f18ac7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ac74 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.726644:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030d4cc83/0xaa46022e3f18ac7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ac74 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529654.726652:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030d4cc83, rc 0) 00000100:00100000:0.0:1788529654.726692:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000866fc212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+7:5810:x1875409185538688:12345-0@lo:101: Request processed in 102us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529654.726699:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788529654.727645:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538688:0@lo:101: 00010000:00010000:3.0:1788529654.727673:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.727682:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529654.727696:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788529654.727720:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.727753:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000ac2b0531/0xaa46022e3f18ac74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529654.727760:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788529654.727766:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529654.727787:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8cabc80f0000 10000000:01000000:3.0:1788529654.727790:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788529654.727800:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788529654.727802:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788529654.727826:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.727832:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.727839:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529654.727853:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538816:0@lo:101: 00000100:00100000:3.0:1788529654.727890:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.727958:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d895fc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529654.728088:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538816 00000100:00100000:2.0:1788529654.728094:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538816 00000100:00100000:2.0:1788529654.728136:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529654.728142:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000230e4fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+7:5810:x1875409185538816:12345-0@lo:101: 00010000:00010000:2.0:1788529654.728153:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529654.728164:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fca89ee/0xaa46022e3f18ac89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ac82 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529654.728181:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fca89ee/0xaa46022e3f18ac89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529654.728190:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fca89ee/0xaa46022e3f18ac89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529654.728197:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fca89ee, rc 0) 00000100:00100000:2.0:1788529654.728264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000230e4fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+8:5810:x1875409185538816:12345-0@lo:101: Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529654.728270:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788529654.728976:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538816:0@lo:101: 00010000:00010000:3.0:1788529654.728992:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529654.729000:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529654.729051:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538944:0@lo:501: 00000100:00100000:3.0:1788529654.729083:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529654.729127:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d895fc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529654.729190:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185538944 00000100:00100000:2.0:1788529654.729195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185538944 00000100:00100000:2.0:1788529654.729228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788529654.729234:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ae3b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+8:5810:x1875409185538944:12345-0@lo:501: 00000100:00100000:2.0:1788529654.729497:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ae3b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5810:x1875409185538944:12345-0@lo:501: Request processed in 263us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529654.729505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788529654.729642:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033e4dbb5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185538944:0@lo:501: 00000100:00100000:0.0:1788529654.729681:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071e36b22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539072:0@lo:503: 00000100:00100000:0.0:1788529654.729727:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529654.729763:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d3da4e0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529654.729819:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539072 00000100:00100000:2.0:1788529654.729823:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539072 00000100:00100000:2.0:1788529654.729856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788529654.729862:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009ac6b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5810:x1875409185539072:12345-0@lo:503: 00000100:00100000:2.0:1788529654.730037:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009ac6b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5810:x1875409185539072:12345-0@lo:503: Request processed in 175us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529654.730050:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788529654.730138:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071e36b22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539072:0@lo:503: 00000100:00100000:1.0:1788529654.731052:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5853:1875409185539200:0@lo:502: 00000100:00100000:1.0:1788529654.731102:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529654.731137:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096f17203 going to sleep for 11 seconds 00000100:00100000:2.0:1788529654.731235:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539200 00000100:00100000:2.0:1788529654.731242:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539200 00000100:00100000:2.0:1788529654.731316:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529654.731323:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dde6cefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5853:x1875409185539200:12345-0@lo:502: 00000100:00100000:2.0:1788529654.731519:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dde6cefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5853:x1875409185539200:12345-0@lo:502: Request processed in 197us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529654.731526:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788529654.731602:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5853:1875409185539200:0@lo:502: 00000020:01000000:1.0:1788529654.731626:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529654.731636:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529654.731638:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788529654.731642:0:5853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788529654.731645:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788529654.731673:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000062151a18) 00000020:00000080:1.0:1788529654.731691:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788529654.731697:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788529654.732230:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788529654.732248:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18ac97 00000020:00000080:1.0:1788529654.732485:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788529654.732492:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529654.732495:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529654.732497:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788529654.732499:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529654.732503:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529654.732504:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788529654.732508:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788529654.732514:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000f8da848) 00000020:00000080:1.0:1788529654.732525:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788529654.732537:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788529654.732538:0:5853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788529654.732541:0:5853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788529654.732547:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788529654.732591:0:5853:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000480f5b3c from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788529654.732602:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000af0a7057) 00000020:00000080:1.0:1788529654.732610:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788529654.732654:0:5853:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788529654.732660:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18acac 00000020:00000080:1.0:1788529654.732769:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788529654.732775:0:5853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788529654.732779:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa46022e3f18acb3 00080000:01000000:1.0:1788529654.732784:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788529654.732787:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18acba 00080000:10000000:1.0:1788529654.733419:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788529654.733649:0:5853:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788529654.739745:0:5853:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788529654.904309:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788529654.905339:0:5853:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788529654.907380:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788529654.907659:0:5853:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788529654.962861:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000bbb54bd1) 00000020:00000080:2.0:1788529654.962884:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788529654.962997:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788529654.963005:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18acc8 00000020:00000080:0.0:1788529654.967768:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788529654.977865:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788529655.041088:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1788529655.117262:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788529655.126426:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529655.209883:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.315601:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.391524:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788529655.459023:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa46022e3f18accf 00000020:00000080:2.0:1788529655.461166:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788529655.461182:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529655.461188:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529655.461192:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788529655.461197:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529655.461203:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529655.461205:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788529655.461209:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788529655.461263:0:5853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788529655.461304:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529655.461307:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529655.461318:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788529655.461322:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529655.461325:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529655.461326:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788529655.461329:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788529655.461331:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788529655.461392:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d206517a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5853:1875409185539328:0@lo:502: 00000100:00100000:2.0:1788529655.461472:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529655.461547:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb3ea710 going to sleep for 11 seconds 00000100:00100000:0.0:1788529655.462138:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539328 00000100:00100000:0.0:1788529655.462147:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539328 00000100:00100000:0.0:1788529655.462196:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788529655.462205:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fb94280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5853:x1875409185539328:12345-0@lo:502: 00000100:00100000:0.0:1788529655.462579:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fb94280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5853:x1875409185539328:12345-0@lo:502: Request processed in 375us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.462588:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788529655.462817:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d206517a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5853:1875409185539328:0@lo:502: 00000020:01000000:3.0:1788529655.462857:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788529655.462863:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529655.462865:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788529655.462870:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788529655.463309:0:5810:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788529655.463319:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788529655.463348:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.463359:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000a43cbe46/0xaa46022e3f18ac82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529655.463367:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc80f0000 from 1 10000000:01000000:0.0:1788529655.463370:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788529655.463410:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.463418:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.463425:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529655.463442:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071e36b22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539456:0@lo:101: 00000100:00100000:0.0:1788529655.463493:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529655.463532:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a746cc34 going to sleep for 11 seconds 00000100:00100000:1.0:1788529655.463656:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539456 00000100:00100000:1.0:1788529655.463673:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539456 00000100:00100000:1.0:1788529655.463715:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788529655.463733:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000916f509d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:5810:x1875409185539456:12345-0@lo:101: 00010000:00010000:1.0:1788529655.463746:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529655.463761:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18acd6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.463783:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.463792:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.463806:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c838522, rc 0) 00000100:00100000:1.0:1788529655.463856:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000916f509d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+10:5810:x1875409185539456:12345-0@lo:101: Request processed in 133us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529655.463861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788529655.464228:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071e36b22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539456:0@lo:101: 00010000:00010000:3.0:1788529655.464242:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.464251:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529655.465157:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d5c4f2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539584:0@lo:256: 00000100:00100000:3.0:1788529655.465214:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529655.465255:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f81e17 going to sleep for 11 seconds 00000100:00100000:3.0:1788529655.465288:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539584 00000100:00100000:3.0:1788529655.465294:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539584 00000100:00100000:3.0:1788529655.465325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529655.465332:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdaadeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+10:5810:x1875409185539584:12345-0@lo:256: 20000000:01000000:3.0:1788529655.465755:0:5823:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788529655.465762:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788529655.469932:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdaadeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+10:5810:x1875409185539584:12345-0@lo:256: Request processed in 4593us (4709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.470250:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529655.474349:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d5c4f2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539584:0@lo:256: 10000000:01000000:3.0:1788529655.477264:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788529655.477363:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.477377:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529655.477386:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc80f0000 from 1 10000000:01000000:3.0:1788529655.477389:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529655.477438:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.477446:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.477457:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529655.477482:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d5c4f2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539712:0@lo:101: 00000100:00100000:3.0:1788529655.477553:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529655.477606:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f81e17 going to sleep for 11 seconds 00000100:00100000:0.0:1788529655.478431:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539712 00000100:00100000:0.0:1788529655.478441:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539712 00000100:00100000:0.0:1788529655.478493:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788529655.478501:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c58f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+10:5810:x1875409185539712:12345-0@lo:101: 00010000:00010000:0.0:1788529655.478516:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529655.478530:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ace4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.478552:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.478562:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.478569:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c97b9f81, rc 0) 00000100:00100000:0.0:1788529655.478619:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c58f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185539712:12345-0@lo:101: Request processed in 119us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.478626:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788529655.478730:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d5c4f2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539712:0@lo:101: 00010000:00010000:0.0:1788529655.478746:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.478754:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529655.478808:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f55307bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539840:0@lo:501: 00000100:00100000:0.0:1788529655.478834:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529655.478857:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046824a41 going to sleep for 11 seconds 00000100:00100000:0.0:1788529655.478874:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539840 00000100:00100000:0.0:1788529655.478878:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539840 00000100:00100000:0.0:1788529655.479146:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788529655.479153:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d5ae19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185539840:12345-0@lo:501: 00000100:00100000:0.0:1788529655.479756:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d5ae19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185539840:12345-0@lo:501: Request processed in 602us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.479764:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788529655.479840:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f55307bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539840:0@lo:501: 00000100:00100000:0.0:1788529655.479874:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f55307bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539968:0@lo:503: 00000100:00100000:0.0:1788529655.481293:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529655.481388:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046824a41 going to sleep for 11 seconds 00000100:00100000:3.0:1788529655.488148:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185539968 00000100:00100000:3.0:1788529655.488169:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185539968 00000100:00100000:3.0:1788529655.488242:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529655.488253:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0003826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185539968:12345-0@lo:503: 00000040:00080000:3.0:1788529655.488442:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529655.488595:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0003826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185539968:12345-0@lo:503: Request processed in 343us (7305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529655.488604:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788529655.492588:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f55307bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185539968:0@lo:503: 00000040:00080000:3.0:1788529655.496746:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788529655.507458:0:5810:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788529655.507479:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788529655.507503:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.507517:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529655.507586:0:5810:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788529655.507589:0:5810:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8cabc80f0000 10000000:01000000:1.0:1788529655.507592:0:5810:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8cabc80f0000 10000000:01000000:1.0:1788529655.507597:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788529655.507617:0:5810:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabc80f0000 from 1 10000000:01000000:1.0:1788529655.507620:0:5810:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788529655.507661:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.507669:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.507680:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529655.507704:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540096:0@lo:101: 00000100:00100000:1.0:1788529655.507806:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.507858:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000008830bf36 going to sleep for 11 seconds 00000100:00100000:0.0:1788529655.508236:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540096 00000100:00100000:0.0:1788529655.508245:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540096 00000100:00100000:0.0:1788529655.508305:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788529655.508315:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a6f25a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185540096:12345-0@lo:101: 00010000:00010000:0.0:1788529655.508329:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529655.508353:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000389c3bca/0xaa46022e3f18acf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18acf2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.508380:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000389c3bca/0xaa46022e3f18acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.508403:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000389c3bca/0xaa46022e3f18acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.508413:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000389c3bca, rc 0) 00000100:00100000:0.0:1788529655.508464:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a6f25a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540096:12345-0@lo:101: Request processed in 151us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.508470:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788529655.508866:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540096:0@lo:101: 00010000:00010000:1.0:1788529655.510136:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.510154:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529655.510224:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540224:0@lo:501: 00000100:00100000:1.0:1788529655.510278:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.510315:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000008830bf36 going to sleep for 11 seconds 00000100:00100000:3.0:1788529655.510472:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540224 00000100:00100000:3.0:1788529655.510479:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540224 00000100:00100000:3.0:1788529655.510524:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788529655.510532:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eec452e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540224:12345-0@lo:501: 00000100:00100000:3.0:1788529655.510824:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eec452e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540224:12345-0@lo:501: Request processed in 293us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529655.510832:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788529655.513647:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540224:0@lo:501: 00000100:00100000:1.0:1788529655.513737:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540352:0@lo:503: 00000100:00100000:1.0:1788529655.513817:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.513867:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000008830bf36 going to sleep for 11 seconds 00000100:00100000:2.0:1788529655.514170:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540352 00000100:00100000:2.0:1788529655.514177:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540352 00000100:00100000:2.0:1788529655.514230:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788529655.514239:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dce75a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540352:12345-0@lo:503: 00000100:00100000:2.0:1788529655.514627:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dce75a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540352:12345-0@lo:503: Request processed in 389us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529655.514636:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788529655.514847:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540352:0@lo:503: 00000100:00100000:3.0:1788529655.515540:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033867edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5858:1875409185540480:0@lo:502: 00000100:00100000:3.0:1788529655.515587:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529655.515628:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059e2befd going to sleep for 11 seconds 00000100:00100000:0.0:1788529655.516246:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540480 00000100:00100000:0.0:1788529655.516255:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540480 00000100:00100000:0.0:1788529655.516307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788529655.516315:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f2816a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5858:x1875409185540480:12345-0@lo:502: 00000100:00100000:0.0:1788529655.516607:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f2816a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5858:x1875409185540480:12345-0@lo:502: Request processed in 293us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.516614:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788529655.516781:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033867edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5858:1875409185540480:0@lo:502: 00000020:01000004:3.0:1788529655.516850:0:5858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788529655.516866:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008ad6a106) 00000020:00000080:3.0:1788529655.516973:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788529655.517084:0:5858:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000480f5b3c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788529655.517089:0:5858:0:(tgt_mount.c:201:server_put_mount()) put mount 00000000480f5b3c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788529655.517092:0:5858:0:(obd_mount.c:712:lustre_put_lsi()) put 00000000480f5b3c 4 00010000:00080000:3.0:1788529655.517126:0:5858:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e58382ee@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1788529655.518811:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788529655.519114:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788529655.519150:0:5858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788529655.519163:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa46022e3f18ad07 00000100:00080000:3.0:1788529655.519173:0:5858:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788529655.519177:0:5858:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e58382ee using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788529655.519219:0:5858:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000033867edf x1875409185540608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788529655.519242:0:5858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788529655.520198:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033867edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185540608:0@lo:38: 00000100:00100000:0.0:1788529655.520276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529655.520419:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540608 00000100:00100000:0.0:1788529655.520428:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540608 00000100:00100000:0.0:1788529655.520461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529655.520467:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f55307bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185540608:12345-0@lo:38: 00000100:00100000:0.0:1788529655.520521:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f55307bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185540608:12345-0@lo:38: Request processed in 52us (244us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788529655.520528:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529655.520571:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788529655.520578:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000e58382ee lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788529655.520582:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788529655.520595:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033867edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185540608:0@lo:38: 00000100:00100000:0.0:1788529655.520853:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004417122a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5858:1875409185540736:0@lo:502: 00000100:00100000:0.0:1788529655.524927:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.533779:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e82032b going to sleep for 11 seconds 00000100:00100000:2.0:1788529655.535127:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540736 00000100:00100000:2.0:1788529655.535141:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540736 00000100:00100000:2.0:1788529655.535210:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788529655.535219:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7ae5f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5858:x1875409185540736:12345-0@lo:502: 00000100:00100000:2.0:1788529655.539065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7ae5f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5858:x1875409185540736:12345-0@lo:502: Request processed in 3839us (18120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529655.539082:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529655.540820:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004417122a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:5858:1875409185540736:0@lo:502: 00000040:00080000:1.0:1788529655.540865:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788529655.540979:0:5810:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788529655.540989:0:5810:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788529655.541006:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.541018:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 0000000091483227/0xaa46022e3f18acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788529655.541078:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788529655.541081:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788529655.541083:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788529655.541084:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788529655.541085:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788529655.541086:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788529655.541087:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788529655.541089:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788529655.541090:0:5810:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788529655.541092:0:5810:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788529655.541093:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788529655.541094:0:5810:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788529655.541097:0:5810:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788529655.541100:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788529655.541101:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788529655.541102:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788529655.541103:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788529655.541104:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788529655.541105:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788529655.541106:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788529655.541107:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788529655.541108:0:5810:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788529655.541108:0:5810:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788529655.541109:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788529655.541110:0:5810:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788529655.541132:0:5810:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788529655.541147:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540864:0@lo:253: 00000100:00100000:1.0:1788529655.541200:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.541238:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9fb5454 going to sleep for 11 seconds 00000100:00100000:2.0:1788529655.544239:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540864 00000100:00100000:2.0:1788529655.544256:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540864 00000100:00100000:2.0:1788529655.544300:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788529655.544309:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003204d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5810:x1875409185540864:12345-0@lo:253: 20000000:01000000:2.0:1788529655.544354:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788529655.544370:0:5823:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788529655.666312:0:5823:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788529655.666344:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788529655.666634:0:5845:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788529655.666639:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788529655.666659:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.666679:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.666687:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.666738:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529655.666753:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 12 pid: 5824 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529655.666768:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1878f87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185540992:0@lo:104: 00000100:00100000:0.0:1788529655.666842:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529655.667114:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000774687c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788529655.667263:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185540992 00000100:00100000:2.0:1788529655.667273:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185540992 00000100:00100000:2.0:1788529655.667328:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788529655.667346:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f20718ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185540992:12345-0@lo:104: 00010000:00010000:2.0:1788529655.667360:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529655.667432:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788529655.667437:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f20718ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185540992:12345-0@lo:104: Request processed in 93us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529655.667445:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529655.667591:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1878f87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185540992:0@lo:104: 00010000:00010000:1.0:1788529655.667612:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667676:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529655.667682:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667689:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098bbd4a8 already unused, calling callback (00000000c00acad5) 10000000:00010000:3.0:1788529655.667692:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667699:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529655.667705:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529655.667710:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529655.667755:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667762:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529655.667787:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667794:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 0000000098bbd4a8/0xaa46022e3f18acd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acdd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529655.667813:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529655.667815:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529655.667829:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529655.667877:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529655.667887:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011e69424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185541120:0@lo:103: 00000100:00100000:3.0:1788529655.668159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529655.668266:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541120 00000100:00100000:1.0:1788529655.668278:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541120 00010000:00010000:1.0:1788529655.668300:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 13 pid: 5824 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529655.668338:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529655.668345:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011bab11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3300:x1875409185541120:12345-0@lo:103: 00010000:00010000:1.0:1788529655.668357:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529655.668361:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 13 pid: 5824 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668371:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 13 pid: 5824 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668384:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c838522/0xaa46022e3f18acdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18acd6 expref: 13 pid: 5824 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668395:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668402:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788529655.668415:0:5814:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001776332s 00010000:00010000:1.0:1788529655.668418:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668424:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668430:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668445:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668450:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1b7efdb already unused, calling callback (0000000099e374c0) 00010000:00010000:1.0:1788529655.668453:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668461:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668472:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668483:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529655.668511:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011bab11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:3300:x1875409185541120:12345-0@lo:103: Request processed in 167us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529655.668518:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788529655.668536:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668543:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529655.668548:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529655.670080:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011e69424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185541120:0@lo:103: 00000100:00100000:2.0:1788529655.685929:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003204d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5810:x1875409185540864:12345-0@lo:253: Request processed in 141579us (144687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529655.686117:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8effdcc pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:5810:1875409185540864:0@lo:253: 10000000:01000000:0.0:1788529655.686138:0:5810:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788529655.686141:0:5810:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788529655.686143:0:5810:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788529655.686145:0:5810:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788529655.686146:0:5810:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788529655.686147:0:5810:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788529655.686162:0:5810:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788529655.686163:0:5810:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788529655.686164:0:5810:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788529655.686166:0:5810:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788529655.686167:0:5810:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788529655.686168:0:5810:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788529655.686170:0:5810:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788529655.686184:0:5810:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788529655.688080:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:10000000:0.0:1788529655.691732:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788529655.692574:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788529655.693289:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788529655.693576:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788529655.695642:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.699218:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788529655.700403:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.700640:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788529655.700848:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.701291:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788529655.701572:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529655.701773:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788529655.810281:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788529655.874472:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788529655.874762:0:5864:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788529655.876623:0:5863:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788529655.876630:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788529655.895492:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788529655.895843:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788529655.900597:0:5810:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788529655.900642:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788529655.902443:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529655.906139:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788529655.907161:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788529655.907208:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788529655.907626:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788529655.907824:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788529655.909887:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788529655.910815:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788529655.912493:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788529655.912665:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788529655.912869:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788529655.915197:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788529655.915404:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788529655.915546:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788529655.915697:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788529655.915843:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788529655.916303:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788529655.916510:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788529655.916683:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788529655.916822:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788529655.917483:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788529655.917647:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788529655.918208:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788529655.918528:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788529655.918769:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788529655.920584:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788529655.920862:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788529655.921246:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788529655.921412:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788529655.921559:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788529655.922420:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788529655.923534:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788529655.924260:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788529655.924553:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788529655.924928:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788529655.925162:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788529655.925476:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788529655.925798:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788529655.926203:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788529655.952441:0:5864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788529656.042250:0:5810:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788529656.042766:0:5810:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5a9c3b0f9b8 00100000:10000000:3.0:1788529656.042775:0:5810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788529656.043840:0:5810:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788529656.043863:0:5810:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788529656.119924:0:5864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788529656.120148:0:5864:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788529656.120153:0:5864:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788529656.141297:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529657.165733:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529658.189580:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529659.215148:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529660.245986:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788529661.006849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788529661.006861:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788529661.006864:0:37:0:(import.c:65:import_set_state_nolock()) 00000000e58382ee lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788529661.006877:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e58382ee using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529661.006914:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096cf2ce3 x1875409185541376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788529661.006963:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096cf2ce3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185541376:0@lo:38: 00000100:00100000:0.0:1788529661.007029:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529661.007108:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541376 00000100:00100000:0.0:1788529661.007116:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541376 00000100:00100000:0.0:1788529661.007145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529661.007151:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dace1f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875409185541376:12345-0@lo:38: 00010000:00080000:0.0:1788529661.007175:0:5831:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000100:00100000:2.0:1788529661.007342:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058e0f006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185541248:0@lo:400: 00000100:00100000:2.0:1788529661.007379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529661.007417:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541248 00000100:00100000:2.0:1788529661.007421:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541248 00000100:00100000:2.0:1788529661.007451:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529661.007457:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000811a8a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:3302:x1875409185541248:12345-0@lo:400: 00000100:00100000:2.0:1788529661.007501:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000811a8a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:3302:x1875409185541248:12345-0@lo:400: Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529661.007508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529661.007550:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058e0f006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185541248:0@lo:400: 00000020:00000080:0.0:1788529661.007644:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa46022e3f18ad15 00000004:00100000:0.0:1788529661.007694:0:5831:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788529661.007814:0:5831:0:(import.c:65:import_set_state_nolock()) 0000000035b160bc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788529661.007934:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dace1f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875409185541376:12345-0@lo:38: Request processed in 781us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529661.007941:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788529661.009970:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096cf2ce3 x1875409185541376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788529671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788529661.009991:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788529661.009999:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788529661.010004:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788529661.010006:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000e58382ee lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788529661.010012:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096cf2ce3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185541376:0@lo:38: 00010000:00010000:1.0:1788529661.266223:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529661.840056:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788529662.286109:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788529662.541023:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788529662.541032:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc80f0000 from 3 10000000:01000000:1.0:1788529662.541037:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788529662.541081:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529662.541094:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529662.541104:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529662.541128:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004384d9c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185541504:0@lo:101: 00000100:00100000:1.0:1788529662.541325:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529662.541443:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056506601 going to sleep for 11 seconds 00000100:00100000:2.0:1788529662.550688:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541504 00000100:00100000:2.0:1788529662.550712:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541504 00000100:00100000:3.0:1788529662.556413:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788529662.556427:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1d4e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5827:x1875409185541504:12345-0@lo:101: 00010000:00010000:3.0:1788529662.556449:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529662.556471:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092cd97ff/0xaa46022e3f18ad23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529662.556500:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092cd97ff/0xaa46022e3f18ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529662.556510:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092cd97ff/0xaa46022e3f18ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529662.556520:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092cd97ff, rc 0) 00000100:00100000:3.0:1788529662.556633:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1d4e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185541504:12345-0@lo:101: Request processed in 208us (15308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529662.556639:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788529662.558668:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004384d9c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185541504:0@lo:101: 00010000:00010000:0.0:1788529662.558710:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529662.558722:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529662.559509:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185541632:0@lo:256: 00000100:00100000:0.0:1788529662.559580:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529662.559775:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7808e87 going to sleep for 11 seconds 00000100:00100000:3.0:1788529662.560533:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541632 00000100:00100000:3.0:1788529662.560546:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541632 00000100:00100000:3.0:1788529662.560620:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788529662.560630:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058a68022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185541632:12345-0@lo:256: 20000000:01000000:3.0:1788529662.560655:0:5822:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788529662.560675:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788529662.560678:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788529662.561628:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058a68022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185541632:12345-0@lo:256: Request processed in 997us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529662.561639:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529662.566287:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185541632:0@lo:256: 10000000:01000000:0.0:1788529662.566537:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788529662.566547:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529662.566558:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000e0a02cda/0xaa46022e3f18ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529663.312669:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529664.333912:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529665.359402:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529666.127940:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529666.127971:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8c28914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185541760:0@lo:400: 00000100:00100000:2.0:1788529666.128048:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529666.128101:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529666.128109:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000373be090 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185541888:0@lo:400: 00000100:00100000:2.0:1788529666.128136:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529666.128180:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541760 00000100:00100000:2.0:1788529666.128189:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541760 00000100:00100000:2.0:1788529666.128233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788529666.128242:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087ae87f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:3302:x1875409185541760:12345-0@lo:400: 00000100:00100000:2.0:1788529666.128288:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087ae87f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:3302:x1875409185541760:12345-0@lo:400: Request processed in 48us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529666.128296:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788529666.128347:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8c28914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185541760:0@lo:400: 00000100:00100000:0.0:1788529666.128518:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185541888 00000100:00100000:0.0:1788529666.128522:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185541888 00000100:00100000:0.0:1788529666.128569:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529666.128576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1839ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185541888:12345-0@lo:400: 00000100:00100000:0.0:1788529666.128635:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1839ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185541888:12345-0@lo:400: Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529666.128641:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788529666.128674:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000373be090 x1875409185541888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529666.128686:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000373be090 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185541888:0@lo:400: 00010000:00010000:0.0:1788529666.383306:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529667.414475:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788529667.446879:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff99f42f70 20000000:00000080:0.0:1788529667.447076:0:6311:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabc3264c00 uarg=0000000000000000 20000000:01000000:0.0:1788529667.447115:0:6311:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788529667.447122:0:6311:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788529667.447190:0:6311:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788529667.447474:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788529667.447563:0:6311:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788529667.451399:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529667.451735:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788529667.451796:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788529667.451844:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788529667.451863:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788529667.451882:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.452041:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.452050:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.452087:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.452108:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529667.452123:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875409185542016:0@lo:104: 00000100:00100000:0.0:1788529667.452197:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529667.452256:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9fb5454 going to sleep for 11 seconds 00000100:00100000:2.0:1788529667.452385:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542016 00000100:00100000:2.0:1788529667.452393:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542016 00000100:00100000:2.0:1788529667.452435:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788529667.452451:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029d3569f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:6311:x1875409185542016:12345-0@lo:104: 00010000:00010000:2.0:1788529667.452464:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452540:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788529667.452546:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029d3569f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:6311:x1875409185542016:12345-0@lo:104: Request processed in 97us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529667.452552:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788529667.452574:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529667.452578:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452585:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc7de666 already unused, calling callback (00000000c00acad5) 10000000:00010000:2.0:1788529667.452588:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452594:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529667.452600:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529667.452605:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788529667.452632:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452639:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529667.452654:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452670:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000cc7de666/0xaa46022e3f18ace4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aceb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529667.452686:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529667.452687:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529667.452689:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529667.452708:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8c28914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185542144:0@lo:103: 00000100:00100000:2.0:1788529667.452744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529667.452924:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542144 00000100:00100000:1.0:1788529667.452929:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542144 00010000:00010000:1.0:1788529667.452949:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529667.452973:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529667.452979:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045b6c1b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:3301:x1875409185542144:12345-0@lo:103: 00010000:00010000:1.0:1788529667.452989:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529667.452992:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453008:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 12 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453022:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453029:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453040:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453046:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453051:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453056:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453060:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1b7efdb already unused, calling callback (0000000099e374c0) 00010000:00010000:1.0:1788529667.453063:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453069:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453077:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529667.453097:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529667.453192:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045b6c1b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:3301:x1875409185542144:12345-0@lo:103: Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529667.453199:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529667.453234:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8c28914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185542144:0@lo:103: 00010000:00010000:0.0:1788529667.453345:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c97b9f81/0xaa46022e3f18aceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ace4 expref: 11 pid: 5824 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529667.453356:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875409185542016:0@lo:104: 00010000:00010000:0.0:1788529667.453369:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.453377:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.453382:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529667.453387:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1b7efdb/0xaa46022e3f18ad2a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529668.442937:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529669.455557:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529670.478258:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529671.245763:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d6c0a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185542272:0@lo:400: 00000100:00100000:2.0:1788529671.245836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529671.245911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529671.245918:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f2f275f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185542400:0@lo:400: 00000100:00100000:2.0:1788529671.245948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529671.245984:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542272 00000100:00100000:2.0:1788529671.245991:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542272 00000100:00100000:2.0:1788529671.246033:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788529671.246040:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000339ec095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:3302:x1875409185542272:12345-0@lo:400: 00000100:00100000:2.0:1788529671.246097:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000339ec095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:3302:x1875409185542272:12345-0@lo:400: Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529671.246104:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788529671.246139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542400 00000100:00100000:2.0:1788529671.246142:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542400 00000100:00100000:2.0:1788529671.246182:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788529671.246189:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078209b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185542400:12345-0@lo:400: 00000100:00100000:2.0:1788529671.246219:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078209b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185542400:12345-0@lo:400: Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529671.246241:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788529671.246278:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009f2f275f x1875409185542400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529671.246292:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f2f275f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185542400:0@lo:400: 00000100:00100000:2.0:1788529671.246314:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d6c0a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185542272:0@lo:400: 00010000:00010000:1.0:1788529671.504684:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788529671.759132:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788529671.759141:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc80f0000 from 1 10000000:01000000:2.0:1788529671.759145:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788529671.759196:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000075af07c6/0xaa46022e3f18ad31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529671.759210:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000075af07c6/0xaa46022e3f18ad31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529671.759221:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000075af07c6/0xaa46022e3f18ad31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529671.759249:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d6c0a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542528:0@lo:101: 00000100:00100000:2.0:1788529671.759333:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529671.759699:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034c6ce81 going to sleep for 11 seconds 00000100:00100000:3.0:1788529671.764804:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542528 00000100:00100000:3.0:1788529671.764822:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542528 00000100:00100000:3.0:1788529671.764977:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788529671.764998:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3404970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+11:5827:x1875409185542528:12345-0@lo:101: 00010000:00010000:3.0:1788529671.765018:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529671.765038:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a7d703a/0xaa46022e3f18ad38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad31 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529671.765078:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a7d703a/0xaa46022e3f18ad38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529671.765090:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a7d703a/0xaa46022e3f18ad38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529671.765099:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a7d703a, rc 0) 00000100:00100000:3.0:1788529671.765179:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3404970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185542528:12345-0@lo:101: Request processed in 184us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529671.765185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529671.765302:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d6c0a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542528:0@lo:101: 00010000:00010000:0.0:1788529671.765321:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000075af07c6/0xaa46022e3f18ad31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529671.765330:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000075af07c6/0xaa46022e3f18ad31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529671.765397:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542656:0@lo:501: 00000100:00100000:0.0:1788529671.765433:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529671.767749:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f691848a going to sleep for 11 seconds 00000100:00100000:2.0:1788529671.768250:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542656 00000100:00100000:2.0:1788529671.768260:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542656 00000100:00100000:2.0:1788529671.768306:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788529671.768314:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ef545d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185542656:12345-0@lo:501: 00000100:00100000:2.0:1788529671.768878:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ef545d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185542656:12345-0@lo:501: Request processed in 561us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529671.768887:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788529671.778428:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062ded2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542656:0@lo:501: 00000100:00100000:1.0:1788529671.778503:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa8a5d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542784:0@lo:503: 00000100:00100000:1.0:1788529671.778587:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529671.778656:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a6eb46e going to sleep for 11 seconds 00000100:00100000:0.0:1788529671.778840:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542784 00000100:00100000:0.0:1788529671.778847:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542784 00000100:00100000:0.0:1788529671.778916:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529671.778924:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b89a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185542784:12345-0@lo:503: 00000100:00100000:0.0:1788529671.779105:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b89a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:5827:x1875409185542784:12345-0@lo:503: Request processed in 182us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529671.779113:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529671.779164:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa8a5d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185542784:0@lo:503: 00000100:00100000:0.0:1788529671.779344:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d666baed pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6552:1875409185542912:0@lo:502: 00000100:00100000:0.0:1788529671.779380:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529671.779401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185542912 00000100:00100000:0.0:1788529671.779404:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185542912 00000100:00100000:0.0:1788529671.779424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529671.779430:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd21ffab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6552:x1875409185542912:12345-0@lo:502: 00000100:00100000:0.0:1788529671.779560:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd21ffab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6552:x1875409185542912:12345-0@lo:502: Request processed in 129us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529671.779567:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529671.779596:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060b5a48e going to sleep for 11 seconds 00000100:00100000:0.0:1788529671.779607:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d666baed pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6552:1875409185542912:0@lo:502: 00000020:01000000:0.0:1788529671.779628:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529671.779637:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529671.779644:0:6552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788529671.779656:0:6552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabc80f0000 00000020:00000080:0.0:1788529671.779658:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788529671.779840:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6552:1875409185543040:0@lo:502: 00000100:00100000:0.0:1788529671.779884:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529671.779926:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543040 00000100:00100000:0.0:1788529671.779930:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543040 00000100:00100000:0.0:1788529671.779951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529671.779958:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6552:x1875409185543040:12345-0@lo:502: 00000100:00100000:0.0:1788529671.780177:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6552:x1875409185543040:12345-0@lo:502: Request processed in 218us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529671.780183:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529671.780213:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd11c3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529671.780225:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6552:1875409185543040:0@lo:502: 00000020:01000000:0.0:1788529671.780241:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529671.780246:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529671.780248:0:6552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788529671.780251:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788529671.780295:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788529671.780302:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788529671.780312:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529671.780323:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529672.527509:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529673.551031:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529674.574016:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788529675.320424:0:6684:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788529675.320429:0:6684:0:(obd_mount.c:928:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788529675.320574:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cabf402e800 00000020:01000004:1.0:1788529675.320590:0:6684:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788529675.320601:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788529675.320672:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cabfce34c98) 00000020:00000080:1.0:1788529675.320688:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788529675.355581:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788529675.355977:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788529675.384486:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788529675.390485:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788529675.390517:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788529675.390569:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788529675.390596:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788529675.391001:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788529675.391013:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788529675.391024:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa46022e3f18ad46 00000020:01000004:3.0:1788529675.391034:0:6684:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788529675.391063:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788529675.391067:0:6684:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788529675.391073:0:6684:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788529675.391078:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788529675.391093:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cabc7431988) 00000020:00000080:3.0:1788529675.391104:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788529675.392221:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529675.399748:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788529675.399765:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788529675.402725:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788529675.402751:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788529675.403825:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788529675.403835:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788529675.406905:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529675.407554:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788529675.407561:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788529675.426468:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788529675.426498:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788529675.471289:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529675.472039:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788529675.472047:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788529675.473286:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788529675.473298:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788529675.491558:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788529675.495742:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788529675.507115:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788529675.507317:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788529675.507332:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788529675.509482:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788529675.509496:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1788529675.597644:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529675.626226:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529675.626535:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788529675.626561:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788529675.633028:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788529675.633047:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788529675.634466:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788529675.634516:0:6684:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788529675.634524:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788529675.634526:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529675.634527:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529675.634529:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529675.634530:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529675.634531:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529675.634533:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529675.634534:0:6684:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529675.634535:0:6684:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529675.634537:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529675.634538:0:6684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529675.634542:0:6684:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788529675.634545:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788529675.634546:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529675.634547:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529675.634549:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529675.634550:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529675.634551:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529675.634552:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529675.634553:0:6684:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529675.634554:0:6684:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529675.634555:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529675.634556:0:6684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529675.634581:0:6684:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788529675.634791:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185543168:0@lo:253: 00000100:00100000:3.0:1788529675.634857:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.634931:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.635009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543168 00000100:00100000:0.0:1788529675.635017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543168 00000100:00100000:0.0:1788529675.635078:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788529675.635087:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185543168:12345-0@lo:253: 20000000:01000000:0.0:1788529675.635125:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788529675.635129:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788529675.635134:0:5824:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788529675.635136:0:5824:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788529675.640238:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529675.641817:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788529675.641863:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788529675.641971:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788529675.641982:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788529675.642319:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788529675.642388:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788529675.644748:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788529675.644782:0:5824:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:1.0:1788529675.644785:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788529675.644820:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788529675.644829:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788529675.644877:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788529675.644885:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:1.0:1788529675.644974:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788529675.645578:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788529675.645805:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788529675.645869:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788529675.646695:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788529675.646716:0:5824:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:1.0:1788529675.646718:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788529675.646752:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788529675.646760:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788529675.646791:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788529675.646798:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:1.0:1788529675.646878:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788529675.646888:0:5824:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788529675.646949:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788529675.646986:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788529675.647003:0:5824:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788529675.647006:0:5824:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788529675.647010:0:5824:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788529675.647023:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788529675.647031:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788529675.647065:0:5824:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788529675.647068:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788529675.658059:0:6699:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788529675.658161:0:6699:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788529675.658215:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788529675.658714:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788529675.658760:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788529675.658798:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788529675.658813:0:5824:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788529675.658816:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788529675.660089:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788529675.660455:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788529675.660502:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788529675.660569:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788529675.660584:0:5824:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788529675.660586:0:5824:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788529675.661346:0:6701:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788529675.661413:0:6701:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788529675.661477:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788529675.661722:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788529675.661761:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788529675.661818:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788529675.661834:0:5824:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788529675.661836:0:5824:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788529675.661845:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788529675.661862:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.661880:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.661889:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.661936:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.661952:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.662115:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.662132:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.662148:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543296:0@lo:104: 00000100:00100000:0.0:1788529675.662220:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788529675.662285:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.662294:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 12 pid: 5822 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.662303:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543424:0@lo:104: 00000100:00100000:0.0:1788529675.662324:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788529675.662346:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.662354:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 12 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.662361:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543552:0@lo:104: 00000100:00100000:0.0:1788529675.662390:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529675.662400:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc51da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.662540:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543296 00000100:00100000:3.0:1788529675.662548:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543296 00000100:00100000:3.0:1788529675.662582:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543424 00000100:00100000:3.0:1788529675.662585:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543424 00000100:00100000:3.0:1788529675.662607:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543552 00000100:00100000:3.0:1788529675.662611:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543552 00000100:00100000:3.0:1788529675.662626:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529675.662647:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5824:x1875409185543296:12345-0@lo:104: 00010000:00010000:3.0:1788529675.662664:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.662733:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788529675.662739:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5824:x1875409185543296:12345-0@lo:104: Request processed in 94us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.662748:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529675.662770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529675.662776:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5824:x1875409185543424:12345-0@lo:104: 00010000:00010000:3.0:1788529675.662784:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.662814:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788529675.662819:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5824:x1875409185543424:12345-0@lo:104: Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.662825:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529675.662834:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788529675.662840:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5824:x1875409185543552:12345-0@lo:104: 00010000:00010000:3.0:1788529675.662847:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.662872:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788529675.662876:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5824:x1875409185543552:12345-0@lo:104: Request processed in 37us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.662881:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788529675.662913:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788529675.662920:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.662933:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529675.662938:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.662946:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529675.662953:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.662958:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529675.663123:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663131:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529675.663151:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663158:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48400/0xaa46022e3f18acf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18acf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663175:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529675.663179:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663185:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529675.663188:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663206:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529675.663211:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.663216:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529675.663231:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663236:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529675.663241:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663247:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18ac82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663257:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529675.663260:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663265:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529675.663267:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663273:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529675.663278:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.663289:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529675.663302:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663307:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529675.663317:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663323:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18ac66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ac6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.663335:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529675.663337:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529675.663339:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529675.663351:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185543808:0@lo:103: 00000100:00100000:3.0:1788529675.663395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529675.663560:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185543680:0@lo:103: 00000100:00100000:2.0:1788529675.663590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529675.663648:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185543936:0@lo:103: 00000100:00100000:2.0:1788529675.663674:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529675.663720:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543808 00000100:00100000:2.0:1788529675.663726:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543808 00010000:00010000:2.0:1788529675.663750:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 13 pid: 5822 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529675.663766:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543680 00000100:00100000:2.0:1788529675.663769:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543680 00010000:00010000:2.0:1788529675.663780:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 14 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529675.663791:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185543936 00000100:00100000:2.0:1788529675.663793:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185543936 00010000:00010000:2.0:1788529675.663803:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 15 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529675.663815:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788529675.663821:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3301:x1875409185543808:12345-0@lo:103: 00010000:00010000:2.0:1788529675.663839:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529675.663845:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 15 pid: 5822 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.663855:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 15 pid: 5822 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.663871:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529675.663919:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3301:x1875409185543808:12345-0@lo:103: Request processed in 98us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.663926:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788529675.663941:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529675.663947:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3300:x1875409185543680:12345-0@lo:103: 00010000:00010000:2.0:1788529675.663956:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529675.663960:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 14 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.663969:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 14 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.663978:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529675.664130:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3300:x1875409185543680:12345-0@lo:103: Request processed in 182us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.664137:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529675.664149:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788529675.664155:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3302:x1875409185543936:12345-0@lo:103: 00010000:00010000:2.0:1788529675.664162:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529675.664166:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 13 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664181:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 13 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664195:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664205:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664221:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664229:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664236:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664242:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664247:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529675.664252:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664260:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664269:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.664287:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529675.664316:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3302:x1875409185543936:12345-0@lo:103: Request processed in 161us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.664322:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788529675.664362:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185543936:0@lo:103: 00000100:00100000:2.0:1788529675.664405:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185543680:0@lo:103: 00010000:00010000:0.0:1788529675.664707:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529675.664753:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18acf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18acf2 expref: 12 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.664767:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543296:0@lo:104: 00010000:00010000:0.0:1788529675.664778:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ac89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ac82 expref: 11 pid: 5822 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.664788:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543424:0@lo:104: 00010000:00010000:0.0:1788529675.664798:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18ac6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ac66 expref: 10 pid: 5824 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.664808:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5824:1875409185543552:0@lo:104: 00010000:00010000:0.0:1788529675.664826:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.664835:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.664843:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.664850:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18ad54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788529675.664867:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788529675.665104:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185543808:0@lo:103: 00000100:00100000:3.0:1788529675.794694:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+9:6684:x1875409185543168:12345-0@lo:253: Request processed in 159597us (159826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.794715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788529675.794868:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185543168:0@lo:253: 10000000:01000000:2.0:1788529675.794885:0:6684:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788529675.794889:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788529675.794890:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529675.794912:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529675.794914:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788529675.794915:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529675.794916:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529675.794918:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529675.794919:0:6684:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788529675.794921:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529675.794923:0:6684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788529675.794948:0:6684:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8cabf402e800 from lustre-OST0000 10000000:01000000:2.0:1788529675.794978:0:6684:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788529675.794982:0:6684:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788529675.794989:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cabf402e800 10000000:01000000:2.0:1788529675.794996:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788529675.795010:0:6684:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788529675.809168:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788529675.844216:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788529675.844234:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabf402e800 from 1 10000000:01000000:0.0:1788529675.844238:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788529675.844280:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.844488:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529675.844501:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529675.844525:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544064:0@lo:101: 00000100:00100000:0.0:1788529675.845106:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529675.845211:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc28a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529675.849680:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544064 00000100:00100000:1.0:1788529675.849699:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544064 00000100:00100000:1.0:1788529675.849814:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788529675.849827:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+9:6684:x1875409185544064:12345-0@lo:101: 00010000:00010000:1.0:1788529675.849849:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529675.849871:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad5b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.849929:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.849943:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.849955:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48c00, rc 0) 00000100:00100000:1.0:1788529675.850064:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544064:12345-0@lo:101: Request processed in 239us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529675.850071:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529675.850179:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544064:0@lo:101: 00010000:00010000:3.0:1788529675.850205:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.850216:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529675.850392:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544192:0@lo:501: 00000100:00100000:3.0:1788529675.850440:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.859854:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.860646:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544192 00000100:00100000:0.0:1788529675.860662:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544192 00000100:00100000:1.0:1788529675.860806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788529675.860821:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544192:12345-0@lo:501: 00000100:00100000:1.0:1788529675.861204:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544192:12345-0@lo:501: Request processed in 386us (10762us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529675.861224:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529675.861455:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544192:0@lo:501: 10000000:01000000:3.0:1788529675.861482:0:6684:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788529675.861543:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544320:0@lo:501: 00000100:00100000:3.0:1788529675.861576:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.866526:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529675.868221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544320 00000100:00100000:2.0:1788529675.868237:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544320 00000100:00100000:2.0:1788529675.868316:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788529675.868328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544320:12345-0@lo:501: 00000100:00100000:2.0:1788529675.868667:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544320:12345-0@lo:501: Request processed in 340us (7089us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788529675.868684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529675.869386:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544320:0@lo:501: 10000000:01000000:3.0:1788529675.869463:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529675.869492:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.869505:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.869519:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8cabf402e800 10000000:01000000:3.0:1788529675.869528:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788529675.869548:0:6684:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788529675.869687:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788529675.869698:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788529675.869708:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8cabc7436620 10000000:01000000:3.0:1788529675.869712:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788529675.869727:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log nodemap-ffff8cabc7436620 from 1 10000000:01000000:3.0:1788529675.869732:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788529675.869780:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.869801:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.869813:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529675.869834:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544448:0@lo:101: 00000100:00100000:3.0:1788529675.869882:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.869957:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529675.870211:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544448 00000100:00100000:2.0:1788529675.870220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544448 00000100:00100000:2.0:1788529675.870253:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788529675.870263:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+10:6684:x1875409185544448:12345-0@lo:101: 00010000:00010000:2.0:1788529675.870280:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529675.870309:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c8000/0xaa46022e3f18ad70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad69 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.870335:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c8000/0xaa46022e3f18ad70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad69 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.870357:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c8000/0xaa46022e3f18ad70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad69 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.870375:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c8000, rc 0) 00000100:00100000:2.0:1788529675.870416:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:6684:x1875409185544448:12345-0@lo:101: Request processed in 154us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.870436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529675.870727:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544448:0@lo:101: 00010000:00010000:3.0:1788529675.870743:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.870752:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.870771:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788529675.870777:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.870785:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529675.870791:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788529675.870796:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529675.870815:0:6684:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788529675.871218:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788529675.871227:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788529675.871245:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8cabf402e800 10000000:01000000:3.0:1788529675.871250:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788529675.871281:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788529675.871413:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788529675.871495:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.871504:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.871513:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529675.871529:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544576:0@lo:101: 00000100:00100000:3.0:1788529675.871567:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.871652:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529675.872117:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544576 00000100:00100000:2.0:1788529675.872129:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544576 00000100:00100000:2.0:1788529675.872213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788529675.872224:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+11:6684:x1875409185544576:12345-0@lo:101: 00010000:00010000:2.0:1788529675.872237:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529675.872254:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad77 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.872279:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.872585:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.872595:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c9800, rc 0) 00000100:00100000:2.0:1788529675.872754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544576:12345-0@lo:101: Request processed in 532us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.872762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529675.872856:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544576:0@lo:101: 00010000:00010000:3.0:1788529675.872873:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.872881:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529675.875189:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544704:0@lo:501: 00000100:00100000:3.0:1788529675.875253:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.875611:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529675.875687:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544704 00000100:00100000:1.0:1788529675.875697:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544704 00000100:00100000:1.0:1788529675.875756:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529675.875774:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544704:12345-0@lo:501: 00000100:00100000:1.0:1788529675.876264:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544704:12345-0@lo:501: Request processed in 499us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529675.876273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788529675.876595:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544704:0@lo:501: 00000100:00100000:3.0:1788529675.876637:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544832:0@lo:503: 00000100:00100000:3.0:1788529675.876689:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.876720:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.876822:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544832 00000100:00100000:0.0:1788529675.876828:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544832 00000100:00100000:0.0:1788529675.876872:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788529675.876880:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544832:12345-0@lo:503: 00000100:00100000:0.0:1788529675.877588:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544832:12345-0@lo:503: Request processed in 706us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529675.877597:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788529675.877690:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544832:0@lo:503: 00000040:00080000:3.0:1788529675.878152:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529675.878239:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544960:0@lo:502: 00000100:00100000:3.0:1788529675.878289:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.878603:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.878760:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185544960 00000100:00100000:0.0:1788529675.878768:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185544960 00000100:00100000:0.0:1788529675.878859:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788529675.878869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544960:12345-0@lo:502: 00000100:00100000:0.0:1788529675.879132:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185544960:12345-0@lo:502: Request processed in 264us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529675.879139:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788529675.879843:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185544960:0@lo:502: 00000040:00080000:3.0:1788529675.880195:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788529675.880259:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788529675.880288:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788529675.880329:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788529675.880532:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788529675.880564:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788529675.880604:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545088:0@lo:502: 00000100:00100000:3.0:1788529675.880671:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.881225:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529675.881516:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545088 00000100:00100000:1.0:1788529675.881528:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545088 00000100:00100000:2.0:1788529675.881722:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788529675.881734:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185545088:12345-0@lo:502: 00000100:00100000:2.0:1788529675.882101:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185545088:12345-0@lo:502: Request processed in 368us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.882110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788529675.882238:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545088:0@lo:502: 00000040:00080000:3.0:1788529675.882440:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788529675.882454:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788529675.883414:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788529675.883607:0:6702:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788529675.883618:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529675.883621:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788529675.883630:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788529675.883667:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8caac4a39988) 00000020:00000080:3.0:1788529675.883698:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788529675.883708:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788529675.883808:0:6702:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabf402e800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788529675.883817:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788529675.883830:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa46022e3f18ad8c 00010000:00010000:3.0:1788529675.895642:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788529675.897736:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788529675.903828:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788529675.905322:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788529675.928753:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788529675.929883:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788529675.937687:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788529675.937703:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529675.937712:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529675.937714:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788529675.937718:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529675.937723:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529675.937725:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788529675.937729:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788529675.937731:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788529675.937811:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529675.937814:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529675.937816:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788529675.937832:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788529675.938612:0:6684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788529675.938634:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788529675.938669:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.938686:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529675.938696:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf402e800 from 1 10000000:01000000:1.0:1788529675.938700:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788529675.938757:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.938766:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.938780:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529675.938828:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545216:0@lo:101: 00000100:00100000:1.0:1788529675.938958:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529675.939541:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545216 00000100:00100000:2.0:1788529675.939550:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545216 00000100:00100000:2.0:1788529675.939606:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788529675.939616:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+12:6684:x1875409185545216:12345-0@lo:101: 00010000:00010000:2.0:1788529675.939630:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529675.939642:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ad93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.939670:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.939681:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.939690:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c8200, rc 0) 00000100:00100000:2.0:1788529675.946172:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:6684:x1875409185545216:12345-0@lo:101: Request processed in 6542us (7199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.946188:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788529675.947232:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788529675.947278:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545216:0@lo:101: 00010000:00010000:1.0:1788529675.947684:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.947700:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529675.948325:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545344:0@lo:256: 00000100:00100000:1.0:1788529675.948659:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.948696:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55eeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529675.949050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545344 00000100:00100000:2.0:1788529675.949059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545344 00000100:00100000:2.0:1788529675.949154:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788529675.949164:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:6684:x1875409185545344:12345-0@lo:256: 20000000:01000000:2.0:1788529675.949187:0:5823:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788529675.949210:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788529675.949212:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788529675.949325:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:6684:x1875409185545344:12345-0@lo:256: Request processed in 161us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.951927:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788529675.952239:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545344:0@lo:256: 10000000:01000000:1.0:1788529675.952856:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788529675.952919:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.952934:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529675.952944:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf402e800 from 1 10000000:01000000:1.0:1788529675.952947:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788529675.953003:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.953012:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.953037:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529675.953065:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545472:0@lo:101: 00000100:00100000:1.0:1788529675.953143:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.957973:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55eeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.958236:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545472 00000100:00100000:3.0:1788529675.958247:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545472 00000100:00100000:3.0:1788529675.958319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788529675.958338:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+13:6684:x1875409185545472:12345-0@lo:101: 00010000:00010000:3.0:1788529675.958362:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529675.958390:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ada1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.958431:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.958445:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.958456:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529675.958595:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545472:12345-0@lo:101: Request processed in 266us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.958602:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788529675.959205:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545472:0@lo:101: 00010000:00010000:1.0:1788529675.959223:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.959232:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529675.963822:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545600:0@lo:501: 00000100:00100000:1.0:1788529675.963938:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.964060:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55eeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.964301:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545600 00000100:00100000:3.0:1788529675.964311:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545600 00000100:00100000:3.0:1788529675.964377:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788529675.964386:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545600:12345-0@lo:501: 00000100:00100000:3.0:1788529675.964866:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545600:12345-0@lo:501: Request processed in 478us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.964875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788529675.965062:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545600:0@lo:501: 00000100:00100000:3.0:1788529675.965119:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545728:0@lo:503: 00000100:00100000:3.0:1788529675.965158:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.965184:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545728 00000100:00100000:3.0:1788529675.965189:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545728 00000100:00100000:3.0:1788529675.965208:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788529675.965215:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545728:12345-0@lo:503: 00000100:00100000:3.0:1788529675.965649:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545728:12345-0@lo:503: Request processed in 431us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.965656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788529675.965714:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.965727:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545728:0@lo:503: 00000040:00080000:3.0:1788529675.967249:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529675.968023:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545856:0@lo:502: 00000100:00100000:3.0:1788529675.968098:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.968140:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.969200:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545856 00000100:00100000:0.0:1788529675.969215:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545856 00000100:00100000:0.0:1788529675.969296:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788529675.969307:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545856:12345-0@lo:502: 00000100:00100000:0.0:1788529675.969570:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545856:12345-0@lo:502: Request processed in 264us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529675.969579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788529675.970530:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545856:0@lo:502: 00000040:00080000:3.0:1788529675.970866:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788529675.971206:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788529675.971245:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545984:0@lo:502: 00000100:00100000:3.0:1788529675.971524:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529675.971585:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788529675.971696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185545984 00000100:00100000:0.0:1788529675.971705:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185545984 00000100:00100000:0.0:1788529675.971786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788529675.971799:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545984:12345-0@lo:502: 00000100:00100000:0.0:1788529675.972245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185545984:12345-0@lo:502: Request processed in 446us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529675.972254:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788529675.972597:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185545984:0@lo:502: 00000040:00080000:3.0:1788529675.972748:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788529675.972767:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788529675.979548:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529675.979567:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529675.979570:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788529675.979578:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabf402e800 00000020:00000080:0.0:1788529675.979581:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788529675.979602:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529675.979605:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529675.979607:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788529675.979610:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788529675.983740:0:6684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788529675.983793:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529675.983883:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.983914:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529675.984230:0:6684:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788529675.984235:0:6684:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8cabf402e800 10000000:01000000:2.0:1788529675.984238:0:6684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8cabf402e800 10000000:01000000:2.0:1788529675.984243:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788529675.984260:0:6684:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788529675.984371:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788529675.984381:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788529675.984397:0:6684:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabf402e800 from 1 10000000:01000000:2.0:1788529675.984400:0:6684:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529675.984463:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.984472:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529675.984485:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529675.984517:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546112:0@lo:101: 00000100:00100000:2.0:1788529675.984616:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529675.984686:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5bb9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.985596:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546112 00000100:00100000:3.0:1788529675.985611:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546112 00000100:00100000:3.0:1788529675.985687:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788529675.985698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:6684:x1875409185546112:12345-0@lo:101: 00010000:00010000:3.0:1788529675.985718:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529675.985736:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18adaf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.985768:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.985780:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529675.985789:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529675.985863:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546112:12345-0@lo:101: Request processed in 166us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529675.985870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788529675.986011:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546112:0@lo:101: 00010000:00010000:1.0:1788529675.986032:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529675.986043:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529675.986174:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546240:0@lo:501: 00000100:00100000:1.0:1788529675.986210:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.986254:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1788529675.986569:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546240 00000100:00100000:3.0:1788529675.986574:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546240 00000100:00100000:3.0:1788529675.986614:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788529675.986622:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546240:12345-0@lo:501: 00000100:00100000:3.0:1788529675.986972:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546240:12345-0@lo:501: Request processed in 350us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529675.987097:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546240:0@lo:501: 00000100:00100000:1.0:1788529675.987132:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546368:0@lo:503: 00000100:00100000:1.0:1788529675.987173:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.987201:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546368 00000100:00100000:1.0:1788529675.987205:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546368 00000100:00100000:1.0:1788529675.987226:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788529675.987233:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:6684:x1875409185546368:12345-0@lo:503: 00000100:00100000:1.0:1788529675.987598:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:6684:x1875409185546368:12345-0@lo:503: Request processed in 363us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529675.987607:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788529675.987658:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee000 going to sleep for 11 seconds 00000100:00100000:1.0:1788529675.987673:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546368:0@lo:503: 00000100:00100000:3.0:1788529675.988086:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000040:00080000:1.0:1788529675.988680:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788529675.988777:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546496:0@lo:502: 00000100:00100000:1.0:1788529675.988845:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529675.988971:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee000 going to sleep for 11 seconds 00000100:00100000:2.0:1788529675.995233:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546496 00000100:00100000:2.0:1788529675.995249:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546496 00000100:00100000:2.0:1788529675.995349:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529675.995371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546496:12345-0@lo:502: 00000100:00100000:2.0:1788529675.995708:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546496:12345-0@lo:502: Request processed in 347us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529675.995716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788529675.996248:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546496:0@lo:502: 00000040:00080000:1.0:1788529675.996707:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788529675.996769:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788529675.996805:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788529675.996866:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788529675.998587:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788529675.998763:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788529675.998804:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788529675.998838:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788529675.998889:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788529676.000320:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788529676.000402:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788529676.000477:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788529676.000513:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788529676.000565:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788529676.000610:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788529676.000646:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788529676.000678:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788529676.000724:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788529676.000757:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788529676.000789:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788529676.000835:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788529676.000869:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788529676.000927:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788529676.000980:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788529676.001013:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788529676.001042:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788529676.001089:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788529676.001121:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788529676.001178:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546624:0@lo:502: 00000100:00100000:1.0:1788529676.001266:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529676.001336:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee000 going to sleep for 11 seconds 00000100:00100000:2.0:1788529676.004022:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546624 00000100:00100000:2.0:1788529676.004046:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546624 00000100:00100000:2.0:1788529676.004164:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788529676.004175:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546624:12345-0@lo:502: 00000100:00100000:2.0:1788529676.004568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185546624:12345-0@lo:502: Request processed in 393us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.004578:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788529676.005538:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185546624:0@lo:502: 00000040:00080000:3.0:1788529676.005684:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788529676.005707:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788529676.006747:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788529676.006767:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8caac4a3cc98) 00000020:00000080:3.0:1788529676.006786:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788529676.006880:0:6707:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabf402e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788529676.006884:0:6707:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabf402e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788529676.006887:0:6707:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabf402e800 3 00010000:00080000:3.0:1788529676.006973:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caac4a2c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1788529676.009888:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788529676.012822:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788529676.012881:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788529676.012924:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa46022e3f18adc4 00000100:00080000:2.0:1788529676.012938:0:6707:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788529676.012947:0:6707:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8caac4a2c800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529676.015801:0:6707:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabc2e87800 x1875409185546752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788529676.015921:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185546752:0@lo:38: 00000100:00100000:1.0:1788529676.016033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788529676.016207:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788529676.016299:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185546880:0@lo:400: 00000100:00100000:2.0:1788529676.016334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529676.016407:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546752 00000100:00100000:2.0:1788529676.016430:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546752 00000100:00100000:2.0:1788529676.016470:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185546880 00000100:00100000:2.0:1788529676.016473:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185546880 00000100:00100000:2.0:1788529676.016506:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788529676.016516:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185546880:12345-0@lo:400: 00000100:00100000:2.0:1788529676.016579:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185546880:12345-0@lo:400: Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.016586:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788529676.016608:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788529676.016613:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185546752:12345-0@lo:38: 00010000:00080000:2.0:1788529676.016663:0:5829:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1788529676.016708:0:5829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa46022e3f18adcb 00000004:00100000:2.0:1788529676.016730:0:5829:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788529676.016776:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8cabd1d03000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788529676.026889:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875409185546752:12345-0@lo:38: Request processed in 10262us (10842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.026930:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788529676.027054:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cabc2e87b80 x1875409185546880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529676.027075:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185546880:0@lo:400: 00000040:00080000:0.0:1788529676.028062:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:1.0:1788529676.028789:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cabc2e87800 x1875409185546752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788529686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529676.028804:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788529676.028821:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788529676.028833:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788529676.028838:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788529676.028842:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788529676.028860:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185546752:0@lo:38: 00000020:01000000:2.0:1788529676.029058:0:6684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788529676.029081:0:6684:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529676.029103:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.029115:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788529676.029170:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788529676.029172:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529676.029174:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529676.029175:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529676.029176:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529676.029178:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529676.029179:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529676.029181:0:6684:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788529676.029183:0:6684:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788529676.029184:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529676.029185:0:6684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788529676.029190:0:6684:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788529676.029196:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788529676.029198:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529676.029199:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529676.029200:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529676.029201:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529676.029202:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529676.029203:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529676.029204:0:6684:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788529676.029205:0:6684:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788529676.029206:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529676.029207:0:6684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788529676.029231:0:6684:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788529676.029245:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185547008:0@lo:253: 00000100:00100000:3.0:1788529676.030213:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529676.030819:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7fa0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529676.031074:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547008 00000100:00100000:0.0:1788529676.031086:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547008 00000100:00100000:0.0:1788529676.031189:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788529676.031200:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6684:x1875409185547008:12345-0@lo:253: 20000000:01000000:0.0:1788529676.031235:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788529676.031248:0:5822:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788529676.086024:0:5822:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788529676.086068:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788529676.086229:0:5845:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788529676.086235:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788529676.086258:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086282:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086291:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086298:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086569:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086595:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 15 pid: 5822 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529676.086615:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185547136:0@lo:104: 00000100:00100000:3.0:1788529676.086703:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788529676.086795:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.086804:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529676.086812:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185547264:0@lo:104: 00000100:00100000:3.0:1788529676.086841:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529676.086860:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc741f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788529676.087096:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788529676.087118:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547136 00000100:00100000:2.0:1788529676.087127:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547136 00000100:00100000:2.0:1788529676.087179:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547264 00000100:00100000:2.0:1788529676.087182:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547264 00000100:00100000:2.0:1788529676.087198:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529676.087206:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5845:x1875409185547136:12345-0@lo:104: 00010000:00010000:2.0:1788529676.087222:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.087297:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788529676.087303:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5845:x1875409185547136:12345-0@lo:104: Request processed in 97us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.087311:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529676.087332:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788529676.088042:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185547264:12345-0@lo:104: 00010000:00010000:2.0:1788529676.088056:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.088151:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788529676.088157:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5b62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185547264:12345-0@lo:104: Request processed in 820us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.088164:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788529676.088707:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529676.088718:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088728:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529676.088734:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088744:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529676.088753:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529676.088759:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788529676.088861:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088870:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529676.088923:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088931:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18ad93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad9a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088949:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529676.088952:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088973:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529676.088976:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.088982:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529676.088988:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529676.088993:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788529676.089444:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185547136:0@lo:104: 00000100:00100000:3.0:1788529676.089459:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185547264:0@lo:104: 00010000:00010000:3.0:1788529676.089488:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.089507:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529676.089521:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529676.089537:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185547392:0@lo:103: 00000100:00100000:3.0:1788529676.089607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529676.092146:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547392 00000100:00100000:2.0:1788529676.092166:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547392 00010000:00010000:2.0:1788529676.092217:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 16 pid: 5822 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529676.092257:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529676.092268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3301:x1875409185547392:12345-0@lo:103: 00010000:00010000:2.0:1788529676.092285:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529676.092291:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 16 pid: 5822 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.092305:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 16 pid: 5822 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.092326:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c8200/0xaa46022e3f18ad9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ad93 expref: 16 pid: 5822 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529676.092344:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529676.092455:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3301:x1875409185547392:12345-0@lo:103: Request processed in 189us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.092462:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788529676.092856:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185547392:0@lo:103: 00010000:00010000:1.0:1788529676.102630:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.102649:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788529676.102706:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185547520:0@lo:103: 00000100:00100000:3.0:1788529676.102809:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529676.103683:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.103698:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48800/0xaa46022e3f18ad1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad23 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.103744:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529676.103748:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529676.103751:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529676.104575:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547520 00000100:00100000:1.0:1788529676.104592:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547520 00010000:00010000:1.0:1788529676.104649:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529676.104692:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788529676.104721:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5077850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3301:x1875409185547520:12345-0@lo:103: 00010000:00010000:1.0:1788529676.104742:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529676.104748:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104775:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104794:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabeff37400/0xaa46022e3f18ad23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ad1c expref: 15 pid: 5823 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104813:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104823:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788529676.104843:0:5814:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018609008s 00010000:00010000:1.0:1788529676.104849:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104856:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104863:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104870:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104876:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529676.104886:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104915:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104932:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529676.104946:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529676.105199:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.105209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529676.105215:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18add2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529676.106139:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5077850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3301:x1875409185547520:12345-0@lo:103: Request processed in 1415us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529676.106150:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788529676.111620:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185547520:0@lo:103: 00000100:00100000:2.0:1788529676.128867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:6684:x1875409185547008:12345-0@lo:253: Request processed in 97659us (98648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529676.128881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788529676.129178:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:6684:1875409185547008:0@lo:253: 10000000:01000000:3.0:1788529676.129196:0:6684:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788529676.129200:0:6684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529676.129202:0:6684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529676.129203:0:6684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529676.129204:0:6684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529676.129206:0:6684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529676.129207:0:6684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529676.129209:0:6684:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529676.129211:0:6684:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529676.129212:0:6684:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529676.129214:0:6684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529676.129216:0:6684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788529676.129238:0:6684:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788529676.146697:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788529676.147709:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788529676.148684:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788529676.149073:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788529676.149389:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788529676.149739:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788529676.152130:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788529676.619710:0:6684:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788529676.619722:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788529676.619799:0:6684:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788529676.619843:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788529676.626500:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529677.645521:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529678.670173:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529679.693186:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529680.717089:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529681.485849:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185547904:0@lo:400: 00000100:00100000:1.0:1788529681.485951:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.486061:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185547648:0@lo:400: 00000100:00100000:2.0:1788529681.486095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.486129:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529681.486136:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185547776:0@lo:400: 00000100:00100000:2.0:1788529681.486159:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.486189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547904 00000100:00100000:2.0:1788529681.486197:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547904 00000100:00100000:2.0:1788529681.486239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547776 00000100:00100000:2.0:1788529681.486242:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547776 00000100:00100000:2.0:1788529681.486255:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529681.486263:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185547904:12345-0@lo:400: 00000100:00100000:2.0:1788529681.486324:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185547904:12345-0@lo:400: Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.486332:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529681.486349:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788529681.486355:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185547776:12345-0@lo:400: 00000100:00100000:2.0:1788529681.486385:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185547776:12345-0@lo:400: Request processed in 30us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.486391:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788529681.486428:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce2f100 x1875409185547776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529681.486441:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185547776:0@lo:400: 00010000:00080000:2.0:1788529681.486471:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce2ca80 x1875409185547904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529681.486480:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185547904:0@lo:400: 00000100:00100000:1.0:1788529681.487694:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185547648 00000100:00100000:1.0:1788529681.487705:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185547648 00000100:00100000:1.0:1788529681.487748:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788529681.487757:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3302:x1875409185547648:12345-0@lo:400: 00000100:00100000:1.0:1788529681.487831:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3302:x1875409185547648:12345-0@lo:400: Request processed in 76us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529681.487838:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788529681.487870:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788529681.490942:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788529681.490967:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf402e800 from 4 10000000:01000000:2.0:1788529681.490972:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788529681.491017:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491029:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491040:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529681.491062:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548032:0@lo:101: 00000100:00100000:2.0:1788529681.491129:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.491166:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.491212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548032 00000100:00100000:2.0:1788529681.491219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548032 00000100:00100000:2.0:1788529681.491264:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788529681.491286:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+13:5827:x1875409185548032:12345-0@lo:101: 00010000:00010000:2.0:1788529681.491300:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529681.491312:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18add9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491335:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491345:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491353:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c8400, rc 0) 00000100:00100000:2.0:1788529681.491391:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185548032:12345-0@lo:101: Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.491405:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788529681.491517:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185547648:0@lo:400: 00000100:00100000:2.0:1788529681.491548:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548032:0@lo:101: 00010000:00010000:2.0:1788529681.491572:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491580:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529681.491624:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548160:0@lo:256: 00000100:00100000:2.0:1788529681.491652:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.491666:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.491676:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548160 00000100:00100000:2.0:1788529681.491679:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548160 00000100:00100000:2.0:1788529681.491698:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788529681.491704:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185548160:12345-0@lo:256: 20000000:01000000:2.0:1788529681.491715:0:5824:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788529681.491730:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788529681.491734:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788529681.491799:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185548160:12345-0@lo:256: Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.491806:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788529681.491831:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548160:0@lo:256: 10000000:01000000:2.0:1788529681.491860:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788529681.491866:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491883:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529681.491919:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788529681.491921:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabc80f0000 from 21 10000000:01000000:2.0:1788529681.491924:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529681.491938:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491945:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.491952:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529681.491962:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548288:0@lo:101: 00000100:00100000:2.0:1788529681.491982:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.492000:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.492009:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548288 00000100:00100000:2.0:1788529681.492012:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548288 00000100:00100000:2.0:1788529681.492029:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788529681.492034:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185548288:12345-0@lo:101: 00010000:00010000:2.0:1788529681.492040:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529681.492048:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ade7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.492061:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.492080:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.492086:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c8800, rc 0) 00000100:00100000:2.0:1788529681.492110:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548288:12345-0@lo:101: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.492115:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788529681.492139:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548288:0@lo:101: 00010000:00010000:2.0:1788529681.492149:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.492155:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529681.492179:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548416:0@lo:501: 00000100:00100000:2.0:1788529681.492199:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.492210:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.492221:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548416 00000100:00100000:2.0:1788529681.492224:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548416 00000100:00100000:2.0:1788529681.492242:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788529681.492248:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548416:12345-0@lo:501: 00000100:00100000:2.0:1788529681.492606:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548416:12345-0@lo:501: Request processed in 357us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.492614:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788529681.492645:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548416:0@lo:501: 00000100:00100000:2.0:1788529681.492669:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548544:0@lo:503: 00000100:00100000:2.0:1788529681.492713:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.492727:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.492739:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548544 00000100:00100000:2.0:1788529681.492742:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548544 00000100:00100000:2.0:1788529681.492763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788529681.492769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548544:12345-0@lo:503: 00000100:00100000:2.0:1788529681.493063:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548544:12345-0@lo:503: Request processed in 293us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.493071:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788529681.493108:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548544:0@lo:503: 00000100:00100000:2.0:1788529681.493347:0:6906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6906:1875409185548672:0@lo:502: 00000100:00100000:2.0:1788529681.493378:0:6906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.493397:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548672 00000100:00100000:2.0:1788529681.493401:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548672 00000100:00100000:2.0:1788529681.493426:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788529681.493432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6906:x1875409185548672:12345-0@lo:502: 00000100:00100000:2.0:1788529681.493606:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6906:x1875409185548672:12345-0@lo:502: Request processed in 174us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.493613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788529681.493650:0:6906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.493663:0:6906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6906:1875409185548672:0@lo:502: 00000100:00100000:2.0:1788529681.493704:0:6906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6906:1875409185548800:0@lo:502: 00000100:00100000:2.0:1788529681.493737:0:6906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.493756:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548800 00000100:00100000:2.0:1788529681.493759:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548800 00000100:00100000:2.0:1788529681.493780:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788529681.493793:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6906:x1875409185548800:12345-0@lo:502: 00000100:00100000:2.0:1788529681.493931:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:6906:x1875409185548800:12345-0@lo:502: Request processed in 138us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.493937:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788529681.493967:0:6906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.493978:0:6906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6906:1875409185548800:0@lo:502: 00000040:00080000:2.0:1788529681.493995:0:6906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788529681.494043:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788529681.494051:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529681.494059:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.494068:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529681.494076:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788529681.494078:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc80f0000 from 4 10000000:01000000:2.0:1788529681.494080:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788529681.494101:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.494108:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.494116:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529681.494126:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548928:0@lo:101: 00000100:00100000:2.0:1788529681.494149:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529681.494172:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.494182:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185548928 00000100:00100000:2.0:1788529681.494185:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185548928 00000100:00100000:2.0:1788529681.494206:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788529681.494211:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185548928:12345-0@lo:101: 00010000:00010000:2.0:1788529681.494218:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529681.494228:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18adf5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.494248:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.494258:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.508146:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc13c9600, rc 0) 00000100:00100000:2.0:1788529681.508276:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185548928:12345-0@lo:101: Request processed in 14050us (14112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.508285:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788529681.508407:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185548928:0@lo:101: 00010000:00010000:3.0:1788529681.508430:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.508442:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529681.508516:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549056:0@lo:256: 00000100:00100000:3.0:1788529681.508558:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529681.508598:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482540 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.508655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549056 00000100:00100000:2.0:1788529681.508663:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549056 00000100:00100000:2.0:1788529681.508706:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788529681.508715:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185549056:12345-0@lo:256: 20000000:01000000:2.0:1788529681.508747:0:5823:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788529681.508764:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788529681.508767:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788529681.508845:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185549056:12345-0@lo:256: Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.508853:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788529681.509322:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549056:0@lo:256: 10000000:01000000:0.0:1788529681.509376:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788529681.509385:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529681.509395:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529681.509404:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788529681.509406:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788529681.509409:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788529681.509436:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529681.509444:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529681.509461:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529681.509476:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549184:0@lo:101: 00000100:00100000:0.0:1788529681.509506:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529681.509528:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.510039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549184 00000100:00100000:2.0:1788529681.510047:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549184 00000100:00100000:2.0:1788529681.510098:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788529681.510108:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185549184:12345-0@lo:101: 00010000:00010000:2.0:1788529681.510121:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529681.510153:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae03 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.510178:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.510190:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529681.510198:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2000, rc 0) 00000100:00100000:2.0:1788529681.510250:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549184:12345-0@lo:101: Request processed in 143us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.510257:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788529681.510384:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549184:0@lo:101: 00010000:00010000:0.0:1788529681.510398:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529681.510407:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529681.510445:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549312:0@lo:501: 00000100:00100000:0.0:1788529681.510471:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529681.510500:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.510547:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549312 00000100:00100000:3.0:1788529681.510553:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549312 00000100:00100000:3.0:1788529681.510587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788529681.510595:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549312:12345-0@lo:501: 00000100:00100000:3.0:1788529681.510890:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549312:12345-0@lo:501: Request processed in 287us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529681.510924:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788529681.512175:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549312:0@lo:501: 00000100:00100000:0.0:1788529681.512230:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549440:0@lo:503: 00000100:00100000:0.0:1788529681.512310:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529681.512352:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.512408:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549440 00000100:00100000:3.0:1788529681.512417:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549440 00000100:00100000:3.0:1788529681.512479:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788529681.512489:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549440:12345-0@lo:503: 00000100:00100000:3.0:1788529681.512871:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549440:12345-0@lo:503: Request processed in 382us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529681.512879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788529681.514409:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549440:0@lo:503: 00000100:00100000:0.0:1788529681.515426:0:6907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6907:1875409185549568:0@lo:502: 00000100:00100000:0.0:1788529681.515520:0:6907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529681.520430:0:6907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77840 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.528378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549568 00000100:00100000:2.0:1788529681.528395:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549568 00000100:00100000:2.0:1788529681.528463:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788529681.528475:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:6907:x1875409185549568:12345-0@lo:502: 00000100:00100000:2.0:1788529681.528828:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:6907:x1875409185549568:12345-0@lo:502: Request processed in 355us (13307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.528836:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788529681.529004:0:6907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6907:1875409185549568:0@lo:502: 00000020:01000000:0.0:1788529681.529048:0:6907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788529681.529056:0:6907:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788529681.529063:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529681.529066:0:6907:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788529681.529071:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788529681.529075:0:6907:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1788529681.529098:0:6907:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788529681.529101:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788529681.529125:0:6907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cabc3eccc98) 00000020:00000080:0.0:1788529681.529146:0:6907:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788529681.529153:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788529681.529228:0:6907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788529681.529234:0:6907:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788529681.529241:0:6907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18ae18 00010000:00080000:0.0:1788529681.529285:0:6907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caac43de000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1788529681.529516:0:6907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788529681.586189:0:6907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788529681.586218:0:6907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788529681.586825:0:6907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529681.590168:0:6907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529681.590243:0:6907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788529681.594214:0:6907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788529681.602450:0:6911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788529681.602461:0:6911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788529681.607258:0:6907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788529681.607284:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788529681.607332:0:6907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788529681.607370:0:6907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18ae1f 00000100:00080000:0.0:1788529681.607384:0:6907:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788529681.607390:0:6907:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8caac43de000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529681.607431:0:6907:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfce28000 x1875409185549696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788529681.607476:0:6907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788529681.607530:0:6907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529681.607535:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529681.607537:0:6907:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788529681.607540:0:6907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529681.607544:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529681.607546:0:6907:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788529681.607550:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788529681.607551:0:6907:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788529681.607585:0:6907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6907:1875409185549824:0@lo:502: 00000100:00100000:0.0:1788529681.607670:0:6907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529681.607858:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185549696:0@lo:8: 00000100:00100000:1.0:1788529681.607923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529681.608006:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549696 00000100:00100000:1.0:1788529681.608012:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549696 00000100:00100000:1.0:1788529681.608049:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529681.608056:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875409185549696:12345-0@lo:8: 00010000:00080000:1.0:1788529681.608082:0:6687:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1788529681.608112:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18ae26 00002000:00100000:1.0:1788529681.608148:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8caac437f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788529681.608152:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788529681.608156:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788529681.608305:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788529681.608451:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788529681.608479:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8caac437b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788529681.608534:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875409185549696:12345-0@lo:8: Request processed in 477us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529681.608541:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788529681.608588:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce28000 x1875409185549696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788529691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529681.608599:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788529681.608607:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788529681.608616:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788529681.608623:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788529681.608625:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac43de000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788529681.608643:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788529681.608649:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185549696:0@lo:8: 00000004:00080000:2.0:1788529681.609171:0:6911:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788529681.609320:0:6911:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 191579425564ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788529681.611612:0:6907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5af7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.616016:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549824 00000100:00100000:3.0:1788529681.616030:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549824 00000100:00100000:3.0:1788529681.616274:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788529681.616287:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:6907:x1875409185549824:12345-0@lo:502: 00000100:00100000:3.0:1788529681.616580:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:6907:x1875409185549824:12345-0@lo:502: Request processed in 295us (8908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529681.616589:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788529681.616662:0:6907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:6907:1875409185549824:0@lo:502: 00000020:01000000:3.0:1788529681.616700:0:6907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788529681.616713:0:6907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529681.616716:0:6907:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788529681.616720:0:6907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788529681.616848:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788529681.616858:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788529681.616866:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.616877:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529681.616925:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788529681.616928:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabc80f0000 from 1 10000000:01000000:3.0:1788529681.616931:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788529681.616965:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.616974:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.616984:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529681.617004:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549952:0@lo:101: 00000100:00100000:3.0:1788529681.617037:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529681.617070:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2885300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.617085:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185549952 00000100:00100000:3.0:1788529681.617090:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185549952 00000100:00100000:3.0:1788529681.617116:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529681.617123:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185549952:12345-0@lo:101: 00010000:00010000:3.0:1788529681.617132:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529681.617151:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae2d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.617173:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.617183:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.617191:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529681.617219:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185549952:12345-0@lo:101: Request processed in 97us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529681.617225:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529681.617255:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185549952:0@lo:101: 00010000:00010000:3.0:1788529681.617278:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.617288:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529681.617318:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185550080:0@lo:501: 00000100:00100000:3.0:1788529681.617340:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529681.617353:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2885300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.617363:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550080 00000100:00100000:3.0:1788529681.617366:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550080 00000100:00100000:3.0:1788529681.617385:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529681.617392:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185550080:12345-0@lo:501: 00000100:00100000:3.0:1788529681.617581:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185550080:12345-0@lo:501: Request processed in 189us (239us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529681.617595:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529681.617624:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185550080:0@lo:501: 10000000:01000000:3.0:1788529681.617634:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529681.617639:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529681.617646:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788529681.673768:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788529681.734777:0:6913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788529681.734809:0:6913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550336:0@lo:7: 00000100:00100000:3.0:1788529681.735064:0:6913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529681.735186:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550336 00000100:00100000:0.0:1788529681.735194:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550336 00000100:00100000:0.0:1788529681.735242:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529681.735252:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1875409185550336:12345-0@lo:7: 00000100:00100000:3.0:1788529681.738405:0:6913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7f556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529681.738449:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185550208:0@lo:13: 00000100:00100000:3.0:1788529681.738515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529681.738753:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550208 00000100:00100000:1.0:1788529681.738763:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550208 00000100:00100000:1.0:1788529681.738805:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529681.738815:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185550208:12345-0@lo:13: 00002000:00000024:1.0:1788529681.738854:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788529681.739211:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185550208:12345-0@lo:13: Request processed in 396us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529681.739218:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788529681.740007:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc83b80 x1875409185550208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529681.740034:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185550208:0@lo:13: 00000100:00080000:2.0:1788529681.741077:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788529681.744352:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788529681.744361:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788529681.744525:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1875409185550336:12345-0@lo:7: Request processed in 9269us (9455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529681.744537:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788529681.746064:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788529681.747027:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc83100 x1875409185550336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788529697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529681.747046:0:6913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550336:0@lo:7: 00000004:00080000:3.0:1788529681.747067:0:6913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788529681.747114:0:6913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550464:0@lo:5: 00000100:00100000:3.0:1788529681.747180:0:6913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529681.747315:0:6913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7f556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529681.750006:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550464 00000100:00100000:0.0:1788529681.750025:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550464 00000100:00100000:0.0:1788529681.750186:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529681.750200:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6913:x1875409185550464:12345-0@lo:5: 00002000:00080000:0.0:1788529681.750245:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788529681.750250:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788529681.750708:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6913:x1875409185550464:12345-0@lo:5: Request processed in 511us (3527us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788529681.750727:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788529681.750818:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc83100 x1875409185550464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788529697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529681.750836:0:6913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550464:0@lo:5: 00000004:00080000:3.0:1788529681.750849:0:6913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788529681.750919:0:6913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc82d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550592:0@lo:700: 00000100:00100000:3.0:1788529681.750961:0:6913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529681.751007:0:6913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7f556c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529681.751226:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550592 00000100:00100000:1.0:1788529681.751232:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550592 00000100:00100000:1.0:1788529681.751279:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529681.751286:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6913:x1875409185550592:12345-0@lo:700: 00000100:00100000:1.0:1788529681.751319:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875409185550720:0@lo:700: 00000100:00100000:1.0:1788529681.751350:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529681.751374:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd11c3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788529681.755054:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550720 00000100:00100000:2.0:1788529681.755069:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550720 00000100:00100000:2.0:1788529681.755146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788529681.755156:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875409185550720:12345-0@lo:700: 40000000:02000000:2.0:1788529681.854828:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788529681.862464:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875409185550720:12345-0@lo:700: Request processed in 107301us (111105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529681.862478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788529681.862732:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce2e680 x1875409185550720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788529697 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529681.862744:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875409185550720:0@lo:700: 40000000:02000000:1.0:1788529681.862756:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788529681.978159:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788529681.978185:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788529681.979145:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6913:x1875409185550592:12345-0@lo:700: Request processed in 227854us (228177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529681.979160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788529681.979285:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc82d80 x1875409185550592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788529697 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529681.979296:0:6913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788529681.979312:0:6913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc82d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550592:0@lo:700: 00000004:02000040:2.0:1788529682.058634:0:6913:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788529682.062006:0:6913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550848:0@lo:5: 00000100:00100000:2.0:1788529682.062096:0:6913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529682.062156:0:6913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd113c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529682.064050:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550848 00000100:00100000:0.0:1788529682.064061:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550848 00000100:00100000:0.0:1788529682.064123:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788529682.064132:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6913:x1875409185550848:12345-0@lo:5: 00002000:00080000:0.0:1788529682.070599:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788529682.070633:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788529682.075764:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6913:x1875409185550848:12345-0@lo:5: Request processed in 11623us (13658us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788529682.075779:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788529682.075852:0:6913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabc2e86d80 x1875409185550848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788529698 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529682.075870:0:6913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6913:1875409185550848:0@lo:5: 00000004:00080000:1.0:1788529682.075887:0:6913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788529682.765209:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529683.789156:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788529684.692607:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788529684.815726:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529685.842553:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529686.861080:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529687.117484:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185550976:0@lo:400: 00000100:00100000:2.0:1788529687.117577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529687.118087:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529687.118096:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185551104:0@lo:400: 00000100:00100000:2.0:1788529687.118127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529687.118160:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551104 00000100:00100000:2.0:1788529687.118167:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551104 00000100:00100000:2.0:1788529687.118230:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529687.118238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185551104:12345-0@lo:400: 00000100:00100000:2.0:1788529687.118289:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185551104:12345-0@lo:400: Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529687.118296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788529687.118337:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabc2e87b80 x1875409185551104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529687.118351:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185551104:0@lo:400: 00000100:00100000:3.0:1788529687.121581:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185551232:0@lo:400: 00000100:00100000:3.0:1788529687.121669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529687.121707:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529687.121715:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185551360:0@lo:400: 00000100:00100000:3.0:1788529687.121741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529687.121934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185550976 00000100:00100000:3.0:1788529687.121944:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185550976 00000100:00100000:3.0:1788529687.121986:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788529687.121994:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3302:x1875409185550976:12345-0@lo:400: 00000100:00100000:3.0:1788529687.122050:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3302:x1875409185550976:12345-0@lo:400: Request processed in 56us (4474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529687.122057:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788529687.123629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551232 00000100:00100000:1.0:1788529687.123646:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551232 00000100:00100000:1.0:1788529687.123702:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788529687.123710:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185551232:12345-0@lo:400: 00000100:00100000:1.0:1788529687.123944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185551232:12345-0@lo:400: Request processed in 234us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529687.123951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788529687.123971:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788529687.124007:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabc2e87480 x1875409185551232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529687.124024:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185551232:0@lo:400: 00000100:00100000:0.0:1788529687.127291:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551360 00000100:00100000:0.0:1788529687.127304:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551360 00000100:00100000:0.0:1788529687.127368:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529687.127378:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185551360:12345-0@lo:400: 00000100:00100000:0.0:1788529687.127541:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185551360:12345-0@lo:400: Request processed in 164us (5797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529687.127548:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788529687.128550:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529687.128598:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabc2e84380 x1875409185551360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529687.128615:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185551360:0@lo:400: 00000100:00100000:1.0:1788529687.128672:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185551488:0@lo:13: 00000100:00100000:1.0:1788529687.128718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529687.128754:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185550976:0@lo:400: 00000100:00100000:1.0:1788529687.129533:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551488 00000100:00100000:1.0:1788529687.129541:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551488 00000100:00100000:1.0:1788529687.129587:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529687.129595:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875409185551488:12345-0@lo:13: 00002000:00000024:1.0:1788529687.129645:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529687.129694:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875409185551488:12345-0@lo:13: Request processed in 100us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529687.129701:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788529687.129736:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce29c00 x1875409185551488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529687.129752:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185551488:0@lo:13: 00000001:00080000:0.0:1788529687.210753:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788529687.885980:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529688.911188:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529689.933702:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529690.959244:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529691.985980:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529692.239237:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185551616:0@lo:13: 00000100:00100000:0.0:1788529692.239321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529692.239414:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551616 00000100:00100000:0.0:1788529692.239422:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551616 00000100:00100000:0.0:1788529692.239472:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529692.239480:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185551616:12345-0@lo:13: 00002000:00000024:0.0:1788529692.239514:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529692.239553:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185551616:12345-0@lo:13: Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529692.239569:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788529692.239605:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce29f80 x1875409185551616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529692.239616:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788529692.239637:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185551616:0@lo:13: 00000100:00080000:0.0:1788529692.239660:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529692.247263:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185552000:0@lo:400: 00000100:00100000:0.0:1788529692.247351:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529692.247732:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185551872:0@lo:400: 00000100:00100000:3.0:1788529692.247766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529692.247791:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529692.247806:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185551744:0@lo:400: 00000100:00100000:3.0:1788529692.247833:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529692.248164:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552000 00000100:00100000:2.0:1788529692.248173:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552000 00000100:00100000:2.0:1788529692.248242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551872 00000100:00100000:2.0:1788529692.248246:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551872 00000100:00100000:2.0:1788529692.248272:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788529692.248281:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185552000:12345-0@lo:400: 00000100:00100000:2.0:1788529692.248345:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185552000:12345-0@lo:400: Request processed in 65us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529692.248353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788529692.248369:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529692.248375:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185551872:12345-0@lo:400: 00000100:00100000:2.0:1788529692.248404:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185551872:12345-0@lo:400: Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529692.248410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529692.248428:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185551744 00000100:00100000:2.0:1788529692.248431:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185551744 00000100:00100000:2.0:1788529692.248453:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788529692.248460:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3301:x1875409185551744:12345-0@lo:400: 00000100:00100000:2.0:1788529692.248485:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3301:x1875409185551744:12345-0@lo:400: Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529692.248499:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788529692.248530:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529692.248553:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185551744:0@lo:400: 00010000:00080000:2.0:1788529692.248568:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce29500 x1875409185551872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529692.248579:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185551872:0@lo:400: 00010000:00080000:2.0:1788529692.248608:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce28000 x1875409185552000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529692.248617:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185552000:0@lo:400: 00010000:00010000:3.0:1788529693.017454:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529694.029136:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529695.055383:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529696.080472:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529697.101203:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529697.357113:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185552128:0@lo:400: 00000100:00100000:3.0:1788529697.357202:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529697.357266:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529697.357273:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185552512:0@lo:400: 00000100:00100000:3.0:1788529697.357301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529697.357336:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552128 00000100:00100000:3.0:1788529697.357344:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552128 00000100:00100000:3.0:1788529697.357386:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788529697.357395:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3303:x1875409185552128:12345-0@lo:400: 00000100:00100000:3.0:1788529697.357438:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3303:x1875409185552128:12345-0@lo:400: Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529697.357445:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788529697.357482:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552512 00000100:00100000:3.0:1788529697.357485:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552512 00000100:00100000:3.0:1788529697.357514:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529697.357521:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185552512:12345-0@lo:400: 00000100:00100000:3.0:1788529697.357554:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185552512:12345-0@lo:400: Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529697.357561:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788529697.357610:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc83800 x1875409185552512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529697.357625:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185552512:0@lo:400: 00000100:00100000:3.0:1788529697.357642:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185552128:0@lo:400: 00000100:00100000:2.0:1788529697.358773:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529697.358788:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185552640:0@lo:13: 00000100:00100000:2.0:1788529697.358828:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529697.358868:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185552256:0@lo:400: 00000100:00100000:3.0:1788529697.358875:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552640 00000100:00100000:3.0:1788529697.358883:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552640 00000100:00100000:3.0:1788529697.358931:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529697.358938:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185552640:12345-0@lo:13: 00002000:00000024:3.0:1788529697.358966:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529697.358980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529697.359019:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529697.359028:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185552384:0@lo:400: 00000100:00100000:3.0:1788529697.359031:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185552640:12345-0@lo:13: Request processed in 90us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529697.359040:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529697.359059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529697.359091:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552256 00000100:00100000:3.0:1788529697.359095:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552256 00000100:00080000:2.0:1788529697.359097:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529697.359123:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552384 00000100:00100000:3.0:1788529697.359127:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552384 00000100:00100000:2.0:1788529697.359138:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788529697.359149:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185552256:12345-0@lo:400: 00000100:00100000:3.0:1788529697.359152:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788529697.359160:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788529697.359176:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788529697.359185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788529697.359194:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185552384:12345-0@lo:400: 00000100:00100000:2.0:1788529697.359196:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185552256:12345-0@lo:400: Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529697.359206:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788529697.359233:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185552384:12345-0@lo:400: Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00080000:2.0:1788529697.359240:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529697.359241:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788529697.359473:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabc2e87b80 x1875409185552640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529697.359491:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185552640:0@lo:13: 00010000:00080000:2.0:1788529697.359520:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc81f80 x1875409185552384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529697.359529:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185552384:0@lo:400: 00010000:00080000:2.0:1788529697.359539:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfbc83480 x1875409185552256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529697.359547:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185552256:0@lo:400: 00000020:01000004:2.0:1788529697.897084:0:7624:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788529697.897089:0:7624:0:(obd_mount.c:928:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788529697.897429:0:7624:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8caac4efb800 00000020:01000004:2.0:1788529697.897450:0:7624:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788529697.897465:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788529697.897481:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cabc2e96620) 00000020:00000080:2.0:1788529697.897499:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788529697.938030:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788529697.939041:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788529697.998403:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788529698.011583:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788529698.011640:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788529698.011713:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788529698.011739:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788529698.012277:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788529698.012293:0:7624:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788529698.012312:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa46022e3f18ae42 00000020:01000004:0.0:1788529698.012322:0:7624:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788529698.012347:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788529698.012351:0:7624:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788529698.012356:0:7624:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788529698.012389:0:7624:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788529698.012393:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788529698.012395:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788529698.012396:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788529698.012398:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788529698.012399:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788529698.012400:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788529698.012402:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788529698.012403:0:7624:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788529698.012407:0:7624:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788529698.012409:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788529698.012411:0:7624:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788529698.012414:0:7624:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788529698.012416:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788529698.012417:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788529698.012418:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788529698.012419:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788529698.012420:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788529698.012420:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788529698.012421:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788529698.012422:0:7624:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788529698.012423:0:7624:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788529698.012424:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788529698.012424:0:7624:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788529698.012464:0:7624:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788529698.012486:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185552768:0@lo:253: 00000100:00100000:0.0:1788529698.012566:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.012636:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.013169:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552768 00000100:00100000:2.0:1788529698.013182:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552768 00000100:00100000:2.0:1788529698.013267:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788529698.013281:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:7624:x1875409185552768:12345-0@lo:253: 20000000:01000000:2.0:1788529698.013343:0:5823:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788529698.013348:0:5823:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788529698.013354:0:5823:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788529698.013357:0:5823:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788529698.023227:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529698.023840:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788529698.023856:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788529698.024002:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788529698.024012:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788529698.024045:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788529698.024272:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788529698.026052:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788529698.026283:0:5823:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:3.0:1788529698.026286:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788529698.026326:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788529698.026334:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788529698.026387:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788529698.026395:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1788529698.026953:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788529698.026962:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788529698.027014:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788529698.027072:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788529698.028740:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788529698.028763:0:5823:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:3.0:1788529698.028764:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788529698.028786:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788529698.028791:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788529698.028805:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788529698.028809:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:3.0:1788529698.028823:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788529698.028827:0:5823:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788529698.028849:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788529698.028867:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788529698.028878:0:5823:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788529698.028880:0:5823:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788529698.028882:0:5823:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788529698.028911:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788529698.028914:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788529698.028938:0:5823:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788529698.028940:0:5823:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788529698.031735:0:7626:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788529698.031828:0:7626:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788529698.031880:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788529698.032833:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788529698.032877:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788529698.032933:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788529698.032946:0:5823:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788529698.032954:0:5823:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788529698.033817:0:7627:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788529698.033879:0:7627:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788529698.033929:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788529698.035479:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788529698.035540:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788529698.035613:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788529698.035627:0:5823:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788529698.035630:0:5823:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788529698.039092:0:7628:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788529698.039381:0:7628:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788529698.039465:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788529698.039807:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788529698.039849:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788529698.039918:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788529698.039933:0:5823:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788529698.039936:0:5823:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788529698.052698:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788529698.053230:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788529698.053275:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788529698.053374:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788529698.053390:0:5823:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788529698.053393:0:5823:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788529698.053402:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788529698.053433:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053452:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053459:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053465:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053472:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053478:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053498:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053506:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053544:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.053560:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.053574:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185552896:0@lo:104: 00000100:00100000:3.0:1788529698.053663:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788529698.055799:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.055815:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.055828:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553024:0@lo:104: 00000100:00100000:3.0:1788529698.055868:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788529698.056006:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.056014:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 18 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.056022:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553152:0@lo:104: 00000100:00100000:3.0:1788529698.056057:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788529698.060726:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.060745:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 18 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.060761:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553280:0@lo:104: 00000100:00100000:3.0:1788529698.060817:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.061111:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185552896 00000100:00100000:1.0:1788529698.061120:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185552896 00000100:00100000:1.0:1788529698.061179:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553024 00000100:00100000:1.0:1788529698.061183:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553024 00000100:00100000:1.0:1788529698.061195:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553152 00000100:00100000:1.0:1788529698.061197:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553152 00000100:00100000:1.0:1788529698.061210:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788529698.061219:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5823:x1875409185552896:12345-0@lo:104: 00010000:00010000:1.0:1788529698.061232:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061282:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788529698.061289:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5823:x1875409185552896:12345-0@lo:104: Request processed in 70us (7626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.061296:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788529698.061312:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788529698.061319:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5823:x1875409185553024:12345-0@lo:104: 00010000:00010000:1.0:1788529698.061339:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061378:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788529698.061383:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5823:x1875409185553024:12345-0@lo:104: Request processed in 66us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.061390:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788529698.061402:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788529698.061408:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5823:x1875409185553152:12345-0@lo:104: 00010000:00010000:1.0:1788529698.061415:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061456:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788529698.061461:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5823:x1875409185553152:12345-0@lo:104: Request processed in 53us (5403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.061466:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788529698.061546:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788529698.061553:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061561:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529698.061565:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061574:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529698.061581:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529698.061602:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788529698.061634:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061641:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529698.061677:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061685:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7000/0xaa46022e3f18ae2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae34 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061698:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529698.061702:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061707:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529698.061710:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061717:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529698.061724:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529698.061728:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788529698.061741:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061746:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529698.061757:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061764:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18ae03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061775:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529698.061778:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061782:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc13c9000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529698.061785:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061790:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529698.061795:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529698.061800:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788529698.061811:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061817:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529698.061830:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061836:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9000/0xaa46022e3f18ade7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.061844:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529698.061854:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529698.061856:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529698.061869:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185553408:0@lo:103: 00000100:00100000:1.0:1788529698.061916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.061951:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529698.061957:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185553536:0@lo:103: 00000100:00100000:1.0:1788529698.061985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.062012:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185553664:0@lo:103: 00000100:00100000:1.0:1788529698.062037:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.062068:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553408 00000100:00100000:1.0:1788529698.062072:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553408 00010000:00010000:1.0:1788529698.062088:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 19 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.062101:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553536 00000100:00100000:1.0:1788529698.062103:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553536 00010000:00010000:1.0:1788529698.062113:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 20 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.062121:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553664 00000100:00100000:1.0:1788529698.062123:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553664 00010000:00010000:1.0:1788529698.062149:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 21 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.062162:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788529698.062169:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3300:x1875409185553408:12345-0@lo:103: 00010000:00010000:1.0:1788529698.062178:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529698.062183:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 21 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062205:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 21 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062220:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529698.062246:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3300:x1875409185553408:12345-0@lo:103: Request processed in 79us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.062252:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788529698.062265:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788529698.062272:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3300:x1875409185553536:12345-0@lo:103: 00010000:00010000:1.0:1788529698.062278:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529698.062282:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 20 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062290:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 20 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062298:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529698.062318:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3300:x1875409185553536:12345-0@lo:103: Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.062323:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788529698.062335:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788529698.062341:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:3302:x1875409185553664:12345-0@lo:103: 00010000:00010000:1.0:1788529698.062348:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529698.062352:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 19 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062361:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 19 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.062376:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529698.062402:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:3302:x1875409185553664:12345-0@lo:103: Request processed in 62us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.062408:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788529698.062446:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185553664:0@lo:103: 00000100:00100000:1.0:1788529698.062470:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185553536:0@lo:103: 00000100:00100000:1.0:1788529698.062478:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185553408:0@lo:103: 00010000:00010000:2.0:1788529698.062801:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529698.062940:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.062951:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.062961:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553792:0@lo:104: 00000100:00100000:3.0:1788529698.062995:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788529698.063025:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.063035:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 18 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.063043:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553920:0@lo:104: 00000100:00100000:3.0:1788529698.063067:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.063077:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c480 going to sleep for 11 seconds 00010000:00010000:3.0:1788529698.063091:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae2d expref: 18 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.063103:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185552896:0@lo:104: 00010000:00010000:3.0:1788529698.063122:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18ae0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae03 expref: 17 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.063132:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553024:0@lo:104: 00010000:00010000:3.0:1788529698.063141:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c8800/0xaa46022e3f18adee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ade7 expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.063149:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553152:0@lo:104: 00000100:00100000:0.0:1788529698.063271:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553280 00000100:00100000:0.0:1788529698.063277:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553280 00000100:00100000:0.0:1788529698.063307:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553792 00000100:00100000:0.0:1788529698.063311:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553792 00000100:00100000:0.0:1788529698.063330:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185553920 00000100:00100000:0.0:1788529698.063333:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185553920 00000100:00100000:0.0:1788529698.063344:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788529698.063350:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5823:x1875409185553280:12345-0@lo:104: 00010000:00010000:0.0:1788529698.063358:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.063407:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529698.063412:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:5823:x1875409185553280:12345-0@lo:104: Request processed in 63us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.063417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788529698.063476:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529698.063487:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.063494:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc13c8600 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529698.063498:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.063514:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529698.063520:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.063525:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529698.063547:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.063553:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529698.063563:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.063569:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8600/0xaa46022e3f18adaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adb6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.063578:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.063580:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.063582:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529698.064066:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788529698.064073:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5823:x1875409185553792:12345-0@lo:104: 00010000:00010000:0.0:1788529698.064082:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.064189:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185554048:0@lo:103: 00000100:00100000:1.0:1788529698.064221:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.064266:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554048 00000100:00100000:1.0:1788529698.064270:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554048 00010000:00010000:1.0:1788529698.064286:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.064306:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788529698.064312:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3303:x1875409185554048:12345-0@lo:103: 00010000:00010000:1.0:1788529698.064319:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529698.064324:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.064336:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.064350:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529698.064376:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3303:x1875409185554048:12345-0@lo:103: Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.064392:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788529698.064433:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185554048:0@lo:103: 00010000:00010000:0.0:1788529698.064517:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529698.064524:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5823:x1875409185553792:12345-0@lo:104: Request processed in 452us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.064530:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788529698.064544:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788529698.064550:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5823:x1875409185553920:12345-0@lo:104: 00010000:00010000:0.0:1788529698.064557:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.064668:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18adb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18adaf expref: 15 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.064688:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553280:0@lo:104: 00000100:00100000:3.0:1788529698.064699:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553792:0@lo:104: 00000100:00100000:3.0:1788529698.064706:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875409185553920:0@lo:104: 00010000:00010000:3.0:1788529698.064731:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.064918:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788529698.064925:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.064943:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529698.064947:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.064955:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529698.064962:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.064968:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529698.065003:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065009:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529698.065026:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065033:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18ad77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad7e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065043:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529698.065046:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065051:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529698.065054:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065071:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529698.065078:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.065083:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529698.065097:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065103:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529698.065108:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065115:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ad5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad62 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.065128:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.065130:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.065132:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529698.065251:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185554304:0@lo:103: 00000100:00100000:1.0:1788529698.065278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.065306:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529698.065311:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185554176:0@lo:103: 00000100:00100000:1.0:1788529698.065329:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.065392:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554304 00000100:00100000:3.0:1788529698.065397:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554304 00010000:00010000:3.0:1788529698.065415:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 15 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.065449:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554176 00000100:00100000:3.0:1788529698.065453:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554176 00010000:00010000:3.0:1788529698.065462:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.065474:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529698.065480:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3301:x1875409185554304:12345-0@lo:103: 00010000:00010000:3.0:1788529698.065494:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529698.065499:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065507:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065517:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18ad62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ad5b expref: 16 pid: 5823 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065526:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529698.065552:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3301:x1875409185554304:12345-0@lo:103: Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.065559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529698.065572:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529698.065578:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3301:x1875409185554176:12345-0@lo:103: 00010000:00010000:3.0:1788529698.065585:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529698.065590:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065601:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065611:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c9800/0xaa46022e3f18ad7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ad77 expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065622:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.065631:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.066031:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185554304:0@lo:103: 00010000:00010000:3.0:1788529698.066081:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066090:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066096:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066102:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066107:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529698.066112:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066120:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066142:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.066152:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529698.066179:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:3301:x1875409185554176:12345-0@lo:103: Request processed in 601us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.066186:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788529698.066237:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185554176:0@lo:103: 00010000:00010000:1.0:1788529698.066255:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.066263:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.066270:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7600/0xaa46022e3f18ae49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788529698.066284:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1788529698.067013:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788529698.067022:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5823:x1875409185553920:12345-0@lo:104: Request processed in 2472us (3953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.067039:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788529698.067133:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.136782:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529698.180237:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+12:7624:x1875409185552768:12345-0@lo:253: Request processed in 166951us (167662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.180252:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788529698.180366:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185552768:0@lo:253: 10000000:01000000:3.0:1788529698.180382:0:7624:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788529698.180385:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529698.180401:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788529698.180402:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529698.180403:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788529698.180405:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529698.180407:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529698.180408:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529698.180410:0:7624:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788529698.180412:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529698.180413:0:7624:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788529698.180666:0:7624:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8caac4efb800 from lustre-OST0001 10000000:01000000:3.0:1788529698.180692:0:7624:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788529698.180696:0:7624:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788529698.180704:0:7624:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8caac4efb800 10000000:01000000:3.0:1788529698.180710:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529698.180723:0:7624:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788529698.229435:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788529698.275533:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788529698.275552:0:7624:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8caac4efb800 from 1 10000000:01000000:0.0:1788529698.275556:0:7624:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788529698.275596:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.275608:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.275619:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.275641:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554432:0@lo:101: 00000100:00100000:0.0:1788529698.275705:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.275762:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.276432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554432 00000100:00100000:1.0:1788529698.276442:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554432 00000100:00100000:1.0:1788529698.276509:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788529698.276519:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+12:7624:x1875409185554432:12345-0@lo:101: 00010000:00010000:1.0:1788529698.276533:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529698.276548:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae50 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.276619:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.276631:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.276641:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49200, rc 0) 00000100:00100000:1.0:1788529698.276699:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554432:12345-0@lo:101: Request processed in 180us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.276706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788529698.276929:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554432:0@lo:101: 00010000:00010000:2.0:1788529698.276947:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.276968:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529698.277081:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554560:0@lo:501: 00000100:00100000:2.0:1788529698.277110:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.277142:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.277616:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554560 00000100:00100000:3.0:1788529698.277621:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554560 00000100:00100000:3.0:1788529698.277651:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788529698.277658:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554560:12345-0@lo:501: 00000100:00100000:3.0:1788529698.277881:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554560:12345-0@lo:501: Request processed in 222us (769us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529698.277888:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788529698.278032:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554560:0@lo:501: 10000000:01000000:2.0:1788529698.278075:0:7624:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788529698.278121:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554688:0@lo:501: 00000100:00100000:2.0:1788529698.278148:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.278177:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.278311:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554688 00000100:00100000:1.0:1788529698.278316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554688 00000100:00100000:1.0:1788529698.278350:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788529698.278357:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554688:12345-0@lo:501: 00000100:00100000:1.0:1788529698.278497:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554688:12345-0@lo:501: Request processed in 140us (347us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529698.278505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788529698.278631:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554688:0@lo:501: 10000000:01000000:2.0:1788529698.278658:0:7624:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788529698.278680:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.278690:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.278704:0:7624:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8caac4efb800 10000000:01000000:2.0:1788529698.278710:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788529698.278727:0:7624:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788529698.278825:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788529698.278832:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788529698.278839:0:7624:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788529698.278842:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788529698.278860:0:7624:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788529698.278917:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788529698.278922:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788529698.278928:0:7624:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8caac4efb800 10000000:01000000:2.0:1788529698.278932:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788529698.278957:0:7624:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788529698.278960:0:7624:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788529698.278993:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279002:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279012:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529698.279024:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554816:0@lo:101: 00000100:00100000:2.0:1788529698.279050:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.279191:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554816 00000100:00100000:2.0:1788529698.279195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554816 00000100:00100000:2.0:1788529698.279223:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788529698.279230:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+13:7624:x1875409185554816:12345-0@lo:101: 00010000:00010000:2.0:1788529698.279240:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529698.279252:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae5e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279274:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279286:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279301:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3000, rc 0) 00000100:00100000:2.0:1788529698.279326:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185554816:12345-0@lo:101: Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.279333:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788529698.279358:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.279371:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554816:0@lo:101: 00010000:00010000:2.0:1788529698.279381:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.279390:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529698.279436:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554944:0@lo:501: 00000100:00100000:2.0:1788529698.279460:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.279478:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185554944 00000100:00100000:2.0:1788529698.279561:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185554944 00000100:00100000:2.0:1788529698.279583:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788529698.280691:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185554944:12345-0@lo:501: 00000100:00100000:2.0:1788529698.280944:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185554944:12345-0@lo:501: Request processed in 261us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.280953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788529698.281004:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.281025:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185554944:0@lo:501: 00000100:00100000:2.0:1788529698.281555:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555072:0@lo:503: 00000100:00100000:2.0:1788529698.281661:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.281708:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.282193:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555072 00000100:00100000:3.0:1788529698.282200:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555072 00000100:00100000:3.0:1788529698.282239:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788529698.282247:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555072:12345-0@lo:503: 00000100:00100000:3.0:1788529698.282413:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555072:12345-0@lo:503: Request processed in 166us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.282420:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788529698.282588:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555072:0@lo:503: 00000040:00080000:2.0:1788529698.282990:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529698.283360:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555200:0@lo:502: 00000100:00100000:2.0:1788529698.283401:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.283434:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.283529:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555200 00000100:00100000:3.0:1788529698.283534:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555200 00000100:00100000:3.0:1788529698.283568:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788529698.283574:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555200:12345-0@lo:502: 00000100:00100000:3.0:1788529698.283725:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555200:12345-0@lo:502: Request processed in 151us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.283733:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788529698.284080:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555200:0@lo:502: 00000040:00080000:2.0:1788529698.284333:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788529698.284380:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788529698.284409:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788529698.284451:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788529698.284493:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788529698.284528:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788529698.284554:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555328:0@lo:502: 00000100:00100000:2.0:1788529698.284761:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.284799:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.284863:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555328 00000100:00100000:3.0:1788529698.284869:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555328 00000100:00100000:3.0:1788529698.284948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788529698.284956:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555328:12345-0@lo:502: 00000100:00100000:3.0:1788529698.285139:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555328:12345-0@lo:502: Request processed in 184us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.285146:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788529698.285399:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555328:0@lo:502: 00000040:00080000:2.0:1788529698.285507:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788529698.285517:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788529698.286390:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788529698.286399:0:7633:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788529698.286405:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529698.286408:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788529698.286416:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788529698.286442:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cabc2e90000) 00000020:00000080:2.0:1788529698.286464:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788529698.286471:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788529698.286741:0:7633:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8caac4efb800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788529698.286750:0:7633:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788529698.286765:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa46022e3f18ae73 00010000:00010000:2.0:1788529698.305561:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788529698.305874:0:7633:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788529698.310390:0:7633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788529698.310690:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788529698.322244:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788529698.323014:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788529698.335360:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788529698.335372:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529698.335379:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529698.335381:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788529698.335385:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529698.335389:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529698.335390:0:7633:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788529698.335393:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788529698.335395:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788529698.335455:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529698.335459:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529698.335461:0:7633:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788529698.335474:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788529698.341286:0:7624:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788529698.341315:0:7624:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788529698.341337:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.341350:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.341358:0:7624:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8caac4efb800 from 1 10000000:01000000:2.0:1788529698.341361:0:7624:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788529698.341396:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.341404:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.341416:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529698.341439:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555456:0@lo:101: 00000100:00100000:2.0:1788529698.341515:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.341564:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.342687:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555456 00000100:00100000:3.0:1788529698.342698:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555456 00000100:00100000:3.0:1788529698.342748:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788529698.342758:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:7624:x1875409185555456:12345-0@lo:101: 00010000:00010000:3.0:1788529698.342770:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529698.342785:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae7a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.342809:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.342820:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.342842:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529698.342918:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:7624:x1875409185555456:12345-0@lo:101: Request processed in 160us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.342925:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788529698.343179:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555456:0@lo:101: 00010000:00010000:2.0:1788529698.343196:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.343206:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529698.343742:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555584:0@lo:256: 00000100:00100000:2.0:1788529698.343784:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.343824:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.345183:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555584 00000100:00100000:3.0:1788529698.345195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555584 00000100:00100000:3.0:1788529698.345246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788529698.345255:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:7624:x1875409185555584:12345-0@lo:256: 20000000:01000000:3.0:1788529698.345278:0:5823:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788529698.345302:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788529698.345306:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788529698.345309:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:3.0:1788529698.345411:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:7624:x1875409185555584:12345-0@lo:256: Request processed in 158us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.345420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788529698.345722:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555584:0@lo:256: 10000000:01000000:2.0:1788529698.349235:0:7624:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788529698.349264:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.349277:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529698.349693:0:7624:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac4efb800 from 1 10000000:01000000:0.0:1788529698.349698:0:7624:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788529698.349746:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.349755:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.349767:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.349795:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555712:0@lo:101: 00000100:00100000:0.0:1788529698.349872:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.350262:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.352008:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555712 00000100:00100000:3.0:1788529698.352021:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555712 00000100:00100000:3.0:1788529698.352088:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788529698.352102:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:7624:x1875409185555712:12345-0@lo:101: 00010000:00010000:3.0:1788529698.352120:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529698.352136:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae88 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.352163:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.352175:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.352198:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529698.352279:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185555712:12345-0@lo:101: Request processed in 180us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.352286:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788529698.353926:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555712:0@lo:101: 00010000:00010000:1.0:1788529698.353950:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529698.353962:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529698.354075:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555840:0@lo:501: 00000100:00100000:1.0:1788529698.354131:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.354168:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2885300 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.354984:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555840 00000100:00100000:2.0:1788529698.354992:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555840 00000100:00100000:2.0:1788529698.355040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788529698.355183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185555840:12345-0@lo:501: 00000100:00100000:2.0:1788529698.355458:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185555840:12345-0@lo:501: Request processed in 408us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.355514:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555840:0@lo:501: 00000100:00100000:0.0:1788529698.355561:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555968:0@lo:503: 00000100:00100000:0.0:1788529698.355612:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.355644:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.355832:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185555968 00000100:00100000:3.0:1788529698.355837:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185555968 00000100:00100000:2.0:1788529698.364180:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788529698.365576:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788529698.365606:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185555968:12345-0@lo:503: 00000100:00100000:0.0:1788529698.366101:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185555968:12345-0@lo:503: Request processed in 504us (10487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.366110:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788529698.366182:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185555968:0@lo:503: 00000040:00080000:2.0:1788529698.366505:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529698.366849:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556096:0@lo:502: 00000100:00100000:2.0:1788529698.366922:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.366962:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.367108:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556096 00000100:00100000:3.0:1788529698.367116:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556096 00000100:00100000:3.0:1788529698.367161:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788529698.367169:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185556096:12345-0@lo:502: 00000100:00100000:3.0:1788529698.367355:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185556096:12345-0@lo:502: Request processed in 186us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.367362:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788529698.367690:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556096:0@lo:502: 00000040:00080000:2.0:1788529698.367955:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788529698.369206:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788529698.369251:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556224:0@lo:502: 00000100:00100000:2.0:1788529698.369306:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.369344:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.369435:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556224 00000100:00100000:1.0:1788529698.369442:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556224 00000100:00100000:1.0:1788529698.369492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788529698.369502:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185556224:12345-0@lo:502: 00000100:00100000:1.0:1788529698.369693:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185556224:12345-0@lo:502: Request processed in 193us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.369701:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788529698.370926:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556224:0@lo:502: 00000040:00080000:3.0:1788529698.371421:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788529698.371435:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788529698.373154:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529698.373166:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529698.373169:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788529698.373176:0:7637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8caac4efb800 00000020:00000080:0.0:1788529698.373179:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788529698.373198:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529698.373201:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529698.373203:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788529698.373205:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788529698.375787:0:7624:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788529698.375827:0:7624:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529698.375857:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.375871:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529698.375979:0:7624:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788529698.375983:0:7624:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8caac4efb800 10000000:01000000:3.0:1788529698.375986:0:7624:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8caac4efb800 10000000:01000000:3.0:1788529698.376004:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529698.376021:0:7624:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788529698.376087:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788529698.376108:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788529698.376121:0:7624:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8caac4efb800 from 1 10000000:01000000:3.0:1788529698.376124:0:7624:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788529698.376173:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.376183:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.376194:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.376215:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556352:0@lo:101: 00000100:00100000:3.0:1788529698.376276:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.376312:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.376423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556352 00000100:00100000:2.0:1788529698.376430:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556352 00000100:00100000:2.0:1788529698.376487:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788529698.376504:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:7624:x1875409185556352:12345-0@lo:101: 00010000:00010000:2.0:1788529698.376518:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529698.376540:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18ae96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.376562:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.376572:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.376581:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2a00, rc 0) 00000100:00100000:2.0:1788529698.376652:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556352:12345-0@lo:101: Request processed in 150us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.376658:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788529698.376942:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556352:0@lo:101: 00010000:00010000:3.0:1788529698.376956:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.376965:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.377036:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556480:0@lo:501: 00000100:00100000:3.0:1788529698.377060:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.377085:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529698.377354:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556480 00000100:00100000:2.0:1788529698.377359:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556480 00000100:00100000:2.0:1788529698.377390:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788529698.377396:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556480:12345-0@lo:501: 00000100:00100000:2.0:1788529698.377840:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556480:12345-0@lo:501: Request processed in 443us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.377848:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788529698.377944:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556480:0@lo:501: 00000100:00100000:3.0:1788529698.377992:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556608:0@lo:503: 00000100:00100000:3.0:1788529698.378028:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.378054:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.378112:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556608 00000100:00100000:1.0:1788529698.378117:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556608 00000100:00100000:1.0:1788529698.378147:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788529698.378155:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556608:12345-0@lo:503: 00000100:00100000:1.0:1788529698.378289:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556608:12345-0@lo:503: Request processed in 135us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.378296:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788529698.379509:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556608:0@lo:503: 00000040:00080000:2.0:1788529698.380020:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529698.380088:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556736:0@lo:502: 00000100:00100000:2.0:1788529698.380141:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.380221:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.382205:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556736 00000100:00100000:1.0:1788529698.382218:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556736 00000100:00100000:1.0:1788529698.382276:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788529698.382298:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556736:12345-0@lo:502: 00000100:00100000:1.0:1788529698.382956:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556736:12345-0@lo:502: Request processed in 659us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.382965:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788529698.383168:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556736:0@lo:502: 00000040:00080000:2.0:1788529698.383736:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788529698.383796:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788529698.383828:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788529698.383868:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788529698.383998:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788529698.384053:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788529698.384088:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788529698.384119:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788529698.384162:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788529698.384196:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788529698.384228:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788529698.384273:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788529698.384305:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788529698.384334:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788529698.384374:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788529698.384402:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788529698.384445:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788529698.385768:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788529698.385844:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788529698.385877:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788529698.385981:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788529698.386023:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788529698.386056:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788529698.386120:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788529698.386165:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788529698.386198:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788529698.386246:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788529698.386280:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788529698.386307:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788529698.386349:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788529698.386384:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788529698.386415:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788529698.386461:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788529698.388101:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788529698.388171:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788529698.388219:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788529698.388254:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788529698.388310:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556864:0@lo:502: 00000100:00100000:2.0:1788529698.388399:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529698.388512:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5acd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788529698.388996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556864 00000100:00100000:3.0:1788529698.389005:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556864 00000100:00100000:3.0:1788529698.389050:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788529698.389058:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556864:12345-0@lo:502: 00000100:00100000:3.0:1788529698.389283:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185556864:12345-0@lo:502: Request processed in 224us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.389291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788529698.389434:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185556864:0@lo:502: 00000040:00080000:2.0:1788529698.389719:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788529698.389731:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788529698.390433:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788529698.390448:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cabfce33310) 00000020:00000080:1.0:1788529698.390470:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788529698.391205:0:7638:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8caac4efb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788529698.391211:0:7638:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8caac4efb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788529698.391214:0:7638:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8caac4efb800 3 00010000:00080000:0.0:1788529698.391244:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabfdede000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1788529698.394233:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788529698.394474:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788529698.394530:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788529698.394540:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa46022e3f18aeab 00000100:00080000:0.0:1788529698.394550:0:7638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788529698.394556:0:7638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cabfdede000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529698.394647:0:7638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfce28700 x1875409185556992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788529698.394670:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788529698.394879:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788529698.395029:0:7639:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cabfce2a300 x1875409185557120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529698.395039:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db180 going to sleep for 0 seconds 00000100:00100000:3.0:1788529698.395214:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185557376:0@lo:400: 00000100:00100000:3.0:1788529698.395280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.395309:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529698.395313:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185557248:0@lo:400: 00000100:00100000:3.0:1788529698.395330:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.395348:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185557504:0@lo:400: 00000100:00100000:3.0:1788529698.395370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.395396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557376 00000100:00100000:3.0:1788529698.395400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557376 00000100:00100000:3.0:1788529698.395431:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557248 00000100:00100000:3.0:1788529698.395433:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557248 00000100:00100000:3.0:1788529698.395463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529698.395470:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185557376:12345-0@lo:400: 00000100:00100000:3.0:1788529698.395510:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185557376:12345-0@lo:400: Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.395516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529698.395547:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529698.395552:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185557248:12345-0@lo:400: 00000100:00100000:3.0:1788529698.395574:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185557248:12345-0@lo:400: Request processed in 23us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.395580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788529698.395622:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabf60cbb80 x1875409185557248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529698.395634:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185557248:0@lo:400: 00010000:00080000:3.0:1788529698.395642:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabf60cb100 x1875409185557376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529698.395650:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185557376:0@lo:400: 00000020:01000000:3.0:1788529698.395671:0:7624:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788529698.395685:0:7624:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788529698.395698:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.395707:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788529698.395756:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788529698.395758:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788529698.395759:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529698.395761:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529698.395762:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529698.395763:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529698.395765:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529698.395766:0:7624:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529698.395767:0:7624:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529698.395768:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529698.395770:0:7624:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788529698.395775:0:7624:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788529698.395777:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788529698.395779:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788529698.395780:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529698.395781:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529698.395782:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529698.395783:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529698.395784:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529698.395785:0:7624:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529698.395786:0:7624:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529698.395786:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529698.395787:0:7624:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788529698.395805:0:7624:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788529698.395812:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185557632:0@lo:253: 00000100:00100000:3.0:1788529698.395838:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.395857:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.396058:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185556992:0@lo:38: 00000100:00100000:1.0:1788529698.396090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.396133:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557632 00000100:00100000:1.0:1788529698.396137:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557632 00000100:00100000:1.0:1788529698.396162:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788529698.396169:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185557632:12345-0@lo:253: 20000000:01000000:1.0:1788529698.396199:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788529698.396215:0:5822:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788529698.397263:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557504 00000100:00100000:0.0:1788529698.397269:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557504 00000100:00100000:0.0:1788529698.397311:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529698.397319:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185557504:12345-0@lo:400: 00000100:00100000:0.0:1788529698.397373:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185557504:12345-0@lo:400: Request processed in 56us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.397380:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788529698.397456:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabf60c8a80 x1875409185557504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529698.397469:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185557504:0@lo:400: 00000100:00100000:3.0:1788529698.400201:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185556992 00000100:00100000:3.0:1788529698.400216:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185556992 00000100:00100000:3.0:1788529698.400256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529698.400263:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875409185556992:12345-0@lo:38: 00010000:00080000:3.0:1788529698.400291:0:5831:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788529698.400323:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa46022e3f18aeb2 00000004:00100000:3.0:1788529698.400338:0:5831:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788529698.400371:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8cabfc239000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529698.400446:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875409185556992:12345-0@lo:38: Request processed in 182us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.400453:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788529698.403773:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce28700 x1875409185556992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788529708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529698.403789:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788529698.403799:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788529698.403808:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788529698.403813:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788529698.403816:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788529698.403823:0:3299:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cce11b61): req@ffff8cabfce2a300 x1875409185557120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529698.403848:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185556992:0@lo:38: 00000100:00100000:0.0:1788529698.404017:0:7639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.404054:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db180 going to sleep for 11 seconds 00000100:00100000:1.0:1788529698.404114:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557120 00000100:00100000:1.0:1788529698.404127:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557120 00000100:00100000:1.0:1788529698.404184:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529698.404193:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875409185557120:12345-0@lo:901: 00000100:00100000:1.0:1788529698.404562:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875409185557120:12345-0@lo:901: Request processed in 369us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.404571:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788529698.404661:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788529698.404707:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfce2a300 x1875409185557120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788529714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529698.404717:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1875409185557120:0@lo:901: 20000000:01000000:2.0:1788529698.460293:0:5822:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788529698.460313:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788529698.462210:0:5845:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788529698.462218:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788529698.462240:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462260:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462284:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462292:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462299:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462348:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.462364:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 17 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.462379:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185557760:0@lo:104: 00000100:00100000:0.0:1788529698.462444:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529698.462871:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788529698.462885:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557760 00000100:00100000:1.0:1788529698.462946:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557760 00000100:00100000:1.0:1788529698.463004:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788529698.463016:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac4eea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185557760:12345-0@lo:104: 00010000:00010000:1.0:1788529698.463030:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.469760:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72cd2bce-e770-4df8-80b5-9001b91d336b:7624:1875409185557632:0@lo:253: 10000000:01000000:3.0:1788529698.469781:0:7624:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788529698.469784:0:7624:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529698.469786:0:7624:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788529698.469787:0:7624:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529698.469802:0:7624:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529698.469803:0:7624:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529698.469804:0:7624:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529698.469806:0:7624:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529698.469807:0:7624:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788529698.469809:0:7624:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788529698.469810:0:7624:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529698.469812:0:7624:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788529698.469828:0:7624:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788529698.470672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:7624:x1875409185557632:12345-0@lo:253: Request processed in 74499us (74829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529698.470686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:1.0:1788529698.472476:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788529698.472497:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac4eea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185557760:12345-0@lo:104: Request processed in 9473us (10043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529698.472509:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788529698.474036:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.474054:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.474070:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185557888:0@lo:104: 00000100:00100000:0.0:1788529698.474141:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788529698.474169:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.474176:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.474199:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185558016:0@lo:104: 00000100:00100000:0.0:1788529698.474240:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.474250:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788529698.474280:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185557760:0@lo:104: 00000100:00100000:0.0:1788529698.474322:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185557888 00000100:00100000:0.0:1788529698.474327:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185557888 00000100:00100000:0.0:1788529698.474360:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558016 00000100:00100000:0.0:1788529698.474363:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558016 00000100:00100000:0.0:1788529698.474376:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788529698.474384:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5845:x1875409185557888:12345-0@lo:104: 00010000:00010000:0.0:1788529698.474396:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788529698.485153:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529698.485343:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00010000:00010000:2.0:1788529698.485760:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788529698.485772:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.485784:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e2e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529698.485789:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.485808:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529698.485815:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.485822:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529698.485917:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.485925:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529698.485951:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.485959:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2e00/0xaa46022e3f18ae7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae81 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.485995:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529698.485998:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.486004:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc13c8200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529698.486007:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.486014:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529698.486020:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529698.486030:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529698.486046:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.486052:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529698.486066:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.486072:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8200/0xaa46022e3f18adf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18adfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529698.486082:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.486083:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529698.486085:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529698.486655:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185558144:0@lo:103: 00000100:00100000:3.0:1788529698.486723:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.486799:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529698.486807:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185558272:0@lo:103: 00000100:00100000:3.0:1788529698.486844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529698.486873:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558144 00000100:00100000:3.0:1788529698.486881:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558144 00010000:00010000:3.0:1788529698.486928:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 17 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.486954:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558272 00000100:00100000:3.0:1788529698.486958:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558272 00010000:00010000:3.0:1788529698.486997:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529698.487014:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529698.487023:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5077c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3301:x1875409185558144:12345-0@lo:103: 00010000:00010000:3.0:1788529698.487044:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529698.487050:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.487079:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.487094:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18ae81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae7a expref: 18 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.487109:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529698.487155:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5077c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:3301:x1875409185558144:12345-0@lo:103: Request processed in 133us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.487162:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529698.487201:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529698.487207:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3303:x1875409185558272:12345-0@lo:103: 00010000:00010000:3.0:1788529698.487215:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529698.487219:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.487228:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529698.487238:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529698.487263:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3303:x1875409185558272:12345-0@lo:103: Request processed in 56us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529698.487270:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529698.487305:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185558144:0@lo:103: 00000100:00100000:3.0:1788529698.487330:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185558272:0@lo:103: 00080000:10000000:3.0:1788529698.487432:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788529698.487672:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788529698.487931:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00010000:00010000:0.0:1788529698.488266:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788529698.488276:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:5845:x1875409185557888:12345-0@lo:104: Request processed in 13890us (14133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.488285:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788529698.488330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c9600/0xaa46022e3f18adfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18adf5 expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.488341:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185557888:0@lo:104: 00010000:00010000:0.0:1788529698.488564:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529698.488576:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788529698.488595:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185558016:12345-0@lo:104: 00010000:00010000:0.0:1788529698.488607:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.488674:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875409185558016:0@lo:104: 00010000:00010000:0.0:1788529698.488698:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488738:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529698.488743:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:5845:x1875409185558016:12345-0@lo:104: Request processed in 161us (14502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.488760:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788529698.488775:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529698.488796:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488803:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc13c8c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529698.488807:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488816:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529698.488823:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529698.488830:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788529698.488859:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488866:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788529698.488881:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488916:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc13c8c00/0xaa46022e3f18add9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ade0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.488932:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529698.488933:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529698.488935:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529698.488965:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529698.488985:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185558400:0@lo:103: 00000100:00100000:0.0:1788529698.489015:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529698.489056:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558400 00000100:00100000:0.0:1788529698.489061:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558400 00010000:00010000:0.0:1788529698.489083:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.489106:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788529698.489113:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3302:x1875409185558400:12345-0@lo:103: 00010000:00010000:0.0:1788529698.489135:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529698.489140:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489155:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489167:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c8400/0xaa46022e3f18ade0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18add9 expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489178:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489196:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788529698.489212:0:5814:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026994159s 00010000:00010000:0.0:1788529698.489217:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489223:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489230:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489236:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489241:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529698.489245:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489252:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489263:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489271:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529698.489320:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3302:x1875409185558400:12345-0@lo:103: Request processed in 208us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529698.489326:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788529698.489352:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489360:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529698.489366:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030a00/0xaa46022e3f18aeb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529698.489391:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185558400:0@lo:103: 00080000:10000000:2.0:1788529698.490355:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788529698.491876:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788529698.775662:0:7624:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788529698.775668:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788529698.775695:0:7624:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788529698.775718:0:7624:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788529699.151690:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529700.172995:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529701.197826:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529702.221220:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529702.483719:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185558528:0@lo:13: 00000100:00100000:0.0:1788529702.483791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529702.483884:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558528 00000100:00100000:0.0:1788529702.483923:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558528 00000100:00100000:0.0:1788529702.483976:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788529702.483986:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185558528:12345-0@lo:13: 00002000:00000024:0.0:1788529702.484019:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529702.484131:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185558528:12345-0@lo:13: Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529702.484138:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788529702.484159:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788529702.484186:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc2e85500 x1875409185558528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529702.484207:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185558528:0@lo:13: 00010000:00010000:2.0:1788529703.245246:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529703.502397:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185558656:0@lo:400: 00000100:00100000:3.0:1788529703.502483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529703.502533:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185559168:0@lo:400: 00000100:00100000:3.0:1788529703.502565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529703.502591:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529703.502597:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185559040:0@lo:400: 00000100:00100000:3.0:1788529703.502620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529703.502646:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185558784:0@lo:400: 00000100:00100000:3.0:1788529703.502669:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529703.502685:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529703.502690:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185558912:0@lo:400: 00000100:00100000:3.0:1788529703.502709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529703.502738:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558656 00000100:00100000:3.0:1788529703.502747:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558656 00000100:00100000:3.0:1788529703.502789:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788529703.502799:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3301:x1875409185558656:12345-0@lo:400: 00000100:00100000:3.0:1788529703.502847:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3301:x1875409185558656:12345-0@lo:400: Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529703.502866:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788529703.502932:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559168 00000100:00100000:3.0:1788529703.502936:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559168 00000100:00100000:3.0:1788529703.502971:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558784 00000100:00100000:3.0:1788529703.502974:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558784 00000100:00100000:3.0:1788529703.502986:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185558912 00000100:00100000:3.0:1788529703.502988:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185558912 00000100:00100000:3.0:1788529703.503003:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529703.503009:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185559168:12345-0@lo:400: 00000100:00100000:3.0:1788529703.503059:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185559168:12345-0@lo:400: Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529703.503067:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529703.503079:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529703.503085:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185558784:12345-0@lo:400: 00000100:00100000:2.0:1788529703.503805:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788529703.503817:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185558912:12345-0@lo:400: 00000100:00100000:2.0:1788529703.503880:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185558912:12345-0@lo:400: Request processed in 66us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529703.503918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788529703.503952:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559040 00000100:00100000:2.0:1788529703.503958:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559040 00000100:00100000:2.0:1788529703.504007:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529703.504014:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185559040:12345-0@lo:400: 00000100:00100000:2.0:1788529703.504049:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185559040:12345-0@lo:400: Request processed in 37us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529703.504056:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788529703.504084:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788529703.504129:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60c9500 x1875409185559040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529703.504201:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185559040:0@lo:400: 00000100:00100000:2.0:1788529703.504214:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185558656:0@lo:400: 00010000:00080000:2.0:1788529703.504228:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60c9180 x1875409185559168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529703.504236:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185559168:0@lo:400: 00010000:00080000:2.0:1788529703.504297:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60caa00 x1875409185558912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529703.504306:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185558912:0@lo:400: 00010000:00080000:2.0:1788529703.504318:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60ca300 x1875409185558784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529703.504325:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185558784:0@lo:400: 00000100:00100000:3.0:1788529703.504815:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185558784:12345-0@lo:400: Request processed in 1727us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529703.504823:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788529704.270529:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788529705.037338:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788529705.037357:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8caac4efb800 from 5 10000000:01000000:0.0:1788529705.037363:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788529705.037420:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.037432:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.037443:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.037466:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559296:0@lo:101: 00000100:00100000:0.0:1788529705.037536:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.037603:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.038695:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559296 00000100:00100000:2.0:1788529705.038705:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559296 00000100:00100000:2.0:1788529705.038774:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788529705.038784:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185559296:12345-0@lo:101: 00010000:00010000:2.0:1788529705.038810:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.038824:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2800/0xaa46022e3f18aec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18aec0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.039245:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2800/0xaa46022e3f18aec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18aec0 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.039258:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2800/0xaa46022e3f18aec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aec0 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.039267:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2800, rc 0) 00000100:00100000:2.0:1788529705.039722:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185559296:12345-0@lo:101: Request processed in 937us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.041057:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559296:0@lo:101: 00010000:00010000:0.0:1788529705.041081:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529705.047073:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1788529705.047527:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.047611:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559424:0@lo:256: 00000100:00100000:0.0:1788529705.047669:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.047705:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.049251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559424 00000100:00100000:2.0:1788529705.049264:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559424 00000100:00100000:2.0:1788529705.049326:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788529705.049337:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185559424:12345-0@lo:256: 20000000:01000000:2.0:1788529705.049363:0:5824:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788529705.049380:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788529705.049383:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788529705.049504:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185559424:12345-0@lo:256: Request processed in 168us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.049512:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788529705.049700:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559424:0@lo:256: 10000000:01000000:0.0:1788529705.049745:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788529705.049755:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.049776:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529705.049793:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788529705.049795:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabf402e800 from 30 10000000:01000000:0.0:1788529705.049798:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788529705.049825:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.049835:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.049845:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.049875:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559552:0@lo:101: 00000100:00100000:0.0:1788529705.049941:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.049976:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.050247:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559552 00000100:00100000:2.0:1788529705.050252:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559552 00000100:00100000:2.0:1788529705.050281:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788529705.050287:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185559552:12345-0@lo:101: 00010000:00010000:2.0:1788529705.050297:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.050315:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18aece expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.050336:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18aece expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.050346:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aece expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.050355:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2200, rc 0) 00000100:00100000:2.0:1788529705.050382:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559552:12345-0@lo:101: Request processed in 95us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.050389:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788529705.052250:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559552:0@lo:101: 00010000:00010000:0.0:1788529705.052275:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.052289:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529705.061000:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788529705.069748:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529705.074367:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788529705.075580:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:1.0:1788529705.075625:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:1.0:1788529705.075686:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:1.0:1788529705.075723:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:1.0:1788529705.075769:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:1.0:1788529705.075803:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:1.0:1788529705.075848:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:1.0:1788529705.075939:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:1.0:1788529705.075978:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:1.0:1788529705.078643:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:1.0:1788529705.078737:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:1.0:1788529705.078773:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:1.0:1788529705.078805:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:1.0:1788529705.078850:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:1.0:1788529705.082379:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:1.0:1788529705.083704:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:1.0:1788529705.083793:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:1.0:1788529705.083830:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:1.0:1788529705.083878:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:1.0:1788529705.083965:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:1.0:1788529705.084016:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:1.0:1788529705.084051:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:1.0:1788529705.084097:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:1.0:1788529705.084138:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:1.0:1788529705.084187:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:1.0:1788529705.084239:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:1.0:1788529705.084276:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:1.0:1788529705.084368:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:1.0:1788529705.084376:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788529705.089320:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559680:0@lo:501: 00000100:00100000:1.0:1788529705.089396:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.089451:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43840 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.091605:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559680 00000100:00100000:3.0:1788529705.091617:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559680 00000100:00100000:3.0:1788529705.091672:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788529705.091680:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559680:12345-0@lo:501: 00000100:00100000:3.0:1788529705.093572:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559680:12345-0@lo:501: Request processed in 1886us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.093583:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788529705.096615:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559680:0@lo:501: 00000100:00100000:2.0:1788529705.096692:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559808:0@lo:503: 00000100:00100000:2.0:1788529705.096762:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.096810:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.096866:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559808 00000100:00100000:2.0:1788529705.096873:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559808 00000100:00100000:2.0:1788529705.096938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788529705.096948:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559808:12345-0@lo:503: 00000100:00100000:2.0:1788529705.097336:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559808:12345-0@lo:503: Request processed in 388us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.097344:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788529705.097388:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559808:0@lo:503: 00000040:00080000:2.0:1788529705.097952:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529705.098021:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559936:0@lo:502: 00000100:00100000:2.0:1788529705.098078:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.098106:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185559936 00000100:00100000:2.0:1788529705.098111:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185559936 00000100:00100000:2.0:1788529705.098133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788529705.098140:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559936:12345-0@lo:502: 00000100:00100000:2.0:1788529705.098353:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185559936:12345-0@lo:502: Request processed in 212us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.098361:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788529705.098392:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.098404:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185559936:0@lo:502: 00000040:00080000:2.0:1788529705.098613:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788529705.098658:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:2.0:1788529705.098692:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:2.0:1788529705.098742:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:2.0:1788529705.098776:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:2.0:1788529705.098822:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:1.0:1788529705.110164:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:1.0:1788529705.110291:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:1.0:1788529705.110376:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:1.0:1788529705.110425:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:1.0:1788529705.110458:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:1.0:1788529705.110510:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:1.0:1788529705.110563:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:1.0:1788529705.110595:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:1.0:1788529705.110641:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:1.0:1788529705.110676:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:1.0:1788529705.110710:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:1.0:1788529705.110782:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:1.0:1788529705.110821:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:1.0:1788529705.110865:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:1.0:1788529705.110952:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:1.0:1788529705.111369:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:1.0:1788529705.111479:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:1.0:1788529705.111536:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:1.0:1788529705.111574:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:1.0:1788529705.111608:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:1.0:1788529705.111658:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:1.0:1788529705.111693:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:1.0:1788529705.111727:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:1.0:1788529705.111774:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:1.0:1788529705.111812:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:1.0:1788529705.111844:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:1.0:1788529705.111890:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:1.0:1788529705.113271:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:1.0:1788529705.113333:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:1.0:1788529705.113380:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:1.0:1788529705.117787:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000100:00100000:1.0:1788529705.117869:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560064:0@lo:502: 00000100:00100000:1.0:1788529705.117977:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.118735:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560064 00000100:00100000:1.0:1788529705.118742:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560064 00000100:00100000:1.0:1788529705.118783:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788529705.118791:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185560064:12345-0@lo:502: 00000100:00100000:0.0:1788529705.119360:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529705.120280:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185560064:12345-0@lo:502: Request processed in 1485us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529705.120292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788529705.121180:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560064:0@lo:502: 00000040:00080000:0.0:1788529705.121337:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:0.0:1788529705.121356:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:0.0:1788529705.126880:0:7850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000020:01000000:0.0:1788529705.126972:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788529705.126986:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788529705.127007:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127020:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529705.127033:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788529705.127036:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf402e800 from 5 10000000:01000000:0.0:1788529705.127041:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788529705.127082:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127090:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127101:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.127124:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560192:0@lo:101: 00000100:00100000:0.0:1788529705.127207:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.127258:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.127364:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560192 00000100:00100000:0.0:1788529705.127371:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560192 00000100:00100000:0.0:1788529705.127661:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788529705.127685:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185560192:12345-0@lo:101: 00010000:00010000:0.0:1788529705.127698:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529705.127711:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18aee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18aedc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127735:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18aee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18aedc expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127747:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18aee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aedc expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127756:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030400, rc 0) 00000100:00100000:0.0:1788529705.127797:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185560192:12345-0@lo:101: Request processed in 114us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.127805:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788529705.127850:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560192:0@lo:101: 00010000:00010000:0.0:1788529705.127876:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.127886:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.127962:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560320:0@lo:256: 00000100:00100000:0.0:1788529705.128054:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.128080:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.128094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560320 00000100:00100000:0.0:1788529705.128097:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560320 00000100:00100000:0.0:1788529705.128121:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788529705.128126:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185560320:12345-0@lo:256: 20000000:01000000:0.0:1788529705.128148:0:5824:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788529705.128167:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788529705.128171:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788529705.128251:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185560320:12345-0@lo:256: Request processed in 123us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.128259:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788529705.128288:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560320:0@lo:256: 10000000:01000000:0.0:1788529705.128322:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788529705.128328:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128335:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529705.128345:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788529705.128347:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788529705.128349:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788529705.128363:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128370:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128377:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.128387:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560448:0@lo:101: 00000100:00100000:0.0:1788529705.128791:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.128807:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.128825:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560448 00000100:00100000:0.0:1788529705.128828:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560448 00000100:00100000:0.0:1788529705.128847:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788529705.128853:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185560448:12345-0@lo:101: 00010000:00010000:0.0:1788529705.128870:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529705.128878:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18aeea expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128916:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128925:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.128932:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030600, rc 0) 00000100:00100000:0.0:1788529705.129097:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560448:12345-0@lo:101: Request processed in 243us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.129103:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788529705.132276:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560448:0@lo:101: 00010000:00010000:1.0:1788529705.132308:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529705.132322:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788529705.137256:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788529705.137702:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529705.142242:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788529705.142337:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:1.0:1788529705.142376:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:1.0:1788529705.146306:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:1.0:1788529705.146390:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:1.0:1788529705.146601:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:1.0:1788529705.146689:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:1.0:1788529705.146700:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788529705.146794:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560576:0@lo:501: 00000100:00100000:1.0:1788529705.146867:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.147354:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529705.149539:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560576 00000100:00100000:1.0:1788529705.149552:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560576 00000100:00100000:3.0:1788529705.155261:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788529705.155279:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560576:12345-0@lo:501: 00000100:00100000:3.0:1788529705.155599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560576:12345-0@lo:501: Request processed in 324us (8741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.155608:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788529705.156278:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560576:0@lo:501: 00000100:00100000:2.0:1788529705.156330:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560704:0@lo:503: 00000100:00100000:2.0:1788529705.156379:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.156430:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.156463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560704 00000100:00100000:2.0:1788529705.156469:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560704 00000100:00100000:2.0:1788529705.156508:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788529705.156515:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560704:12345-0@lo:503: 00000100:00100000:2.0:1788529705.156805:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560704:12345-0@lo:503: Request processed in 290us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.156813:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788529705.156867:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560704:0@lo:503: 00000040:00080000:2.0:1788529705.157372:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529705.157431:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560832:0@lo:502: 00000100:00100000:2.0:1788529705.157467:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.157491:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560832 00000100:00100000:2.0:1788529705.157495:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560832 00000100:00100000:2.0:1788529705.157517:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788529705.157523:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560832:12345-0@lo:502: 00000100:00100000:2.0:1788529705.157677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560832:12345-0@lo:502: Request processed in 151us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.157684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788529705.157714:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.157727:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560832:0@lo:502: 00000040:00080000:2.0:1788529705.157970:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788529705.158019:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:2.0:1788529705.158052:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788529705.158096:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788529705.158134:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788529705.158168:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788529705.158222:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:2.0:1788529705.158260:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788529705.158293:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:2.0:1788529705.158317:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560960:0@lo:502: 00000100:00100000:2.0:1788529705.158351:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.158377:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185560960 00000100:00100000:2.0:1788529705.158381:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185560960 00000100:00100000:2.0:1788529705.158404:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788529705.158411:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560960:12345-0@lo:502: 00000100:00100000:2.0:1788529705.158536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185560960:12345-0@lo:502: Request processed in 124us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.158542:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788529705.158571:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.158584:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185560960:0@lo:502: 00000040:00080000:2.0:1788529705.158654:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:2.0:1788529705.158663:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000020:01000000:2.0:1788529705.159315:0:7852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529705.159324:0:7852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529705.159327:0:7852:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788529705.159331:0:7852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788529705.159332:0:7852:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788529705.159346:0:7852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529705.159349:0:7852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529705.159351:0:7852:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788529705.159354:0:7852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788529705.159383:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788529705.159391:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788529705.159400:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.159412:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529705.159424:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788529705.172661:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabf402e800 from 1 10000000:01000000:2.0:1788529705.172673:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788529705.174620:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529705.174634:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529705.174658:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529705.174680:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561088:0@lo:101: 00000100:00100000:1.0:1788529705.174744:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.174779:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43540 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.175845:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561088 00000100:00100000:2.0:1788529705.175867:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561088 00000100:00100000:2.0:1788529705.175965:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788529705.175981:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185561088:12345-0@lo:101: 00010000:00010000:2.0:1788529705.175994:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.176007:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18aef8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176033:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176045:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176054:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3c00, rc 0) 00000100:00100000:2.0:1788529705.176105:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561088:12345-0@lo:101: Request processed in 126us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.176112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788529705.176165:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561088:0@lo:101: 00010000:00010000:2.0:1788529705.176182:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176192:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529705.176283:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561216:0@lo:501: 00000100:00100000:2.0:1788529705.176310:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.176327:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.176339:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561216 00000100:00100000:2.0:1788529705.176343:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561216 00000100:00100000:2.0:1788529705.176367:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788529705.176374:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561216:12345-0@lo:501: 00000100:00100000:2.0:1788529705.176576:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561216:12345-0@lo:501: Request processed in 202us (265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788529705.176583:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788529705.176609:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561216:0@lo:501: 10000000:01000000:2.0:1788529705.176621:0:5827:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788529705.176655:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561344:0@lo:501: 00000100:00100000:2.0:1788529705.176674:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.176690:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561344 00000100:00100000:2.0:1788529705.176693:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561344 00000100:00100000:2.0:1788529705.176707:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788529705.176712:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561344:12345-0@lo:501: 00000100:00100000:2.0:1788529705.176809:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561344:12345-0@lo:501: Request processed in 95us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788529705.176816:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788529705.176835:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.176845:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561344:0@lo:501: 10000000:01000000:2.0:1788529705.176883:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788529705.176890:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176917:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529705.176927:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788529705.176929:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabc80f0000 from 30 10000000:01000000:2.0:1788529705.176932:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529705.176955:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176962:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.176971:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529705.176982:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561472:0@lo:101: 00000100:00100000:2.0:1788529705.177005:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.177022:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561472 00000100:00100000:2.0:1788529705.177026:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561472 00000100:00100000:2.0:1788529705.177042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788529705.177048:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185561472:12345-0@lo:101: 00010000:00010000:2.0:1788529705.177054:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.177063:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18af06 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.177077:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.177085:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.177092:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3e00, rc 0) 00000100:00100000:2.0:1788529705.177113:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185561472:12345-0@lo:101: Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.177119:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788529705.177138:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.177155:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561472:0@lo:101: 00010000:00010000:2.0:1788529705.177165:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.177173:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529705.177197:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561600:0@lo:501: 00000100:00100000:2.0:1788529705.177219:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.177236:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561600 00000100:00100000:2.0:1788529705.177239:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561600 00000100:00100000:2.0:1788529705.177255:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788529705.177260:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185561600:12345-0@lo:501: 00000100:00100000:2.0:1788529705.177381:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185561600:12345-0@lo:501: Request processed in 120us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.177389:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788529705.177407:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.177417:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561600:0@lo:501: 00000100:00100000:2.0:1788529705.177440:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561728:0@lo:503: 00000100:00100000:2.0:1788529705.177475:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.177492:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561728 00000100:00100000:2.0:1788529705.177496:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561728 00000100:00100000:2.0:1788529705.177511:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788529705.177517:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185561728:12345-0@lo:503: 00000100:00100000:2.0:1788529705.177648:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185561728:12345-0@lo:503: Request processed in 130us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.177654:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788529705.177684:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.177695:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185561728:0@lo:503: 00000100:00100000:2.0:1788529705.177963:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7854:1875409185561856:0@lo:502: 00000100:00100000:2.0:1788529705.177995:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.178012:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561856 00000100:00100000:2.0:1788529705.178015:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561856 00000100:00100000:2.0:1788529705.178035:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788529705.178041:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:7854:x1875409185561856:12345-0@lo:502: 00000100:00100000:2.0:1788529705.178183:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:7854:x1875409185561856:12345-0@lo:502: Request processed in 142us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.178190:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788529705.178221:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.178237:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7854:1875409185561856:0@lo:502: 00000100:00100000:2.0:1788529705.178273:0:7854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7854:1875409185561984:0@lo:502: 00000100:00100000:2.0:1788529705.178303:0:7854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.178320:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185561984 00000100:00100000:2.0:1788529705.178324:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185561984 00000100:00100000:2.0:1788529705.178344:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788529705.178350:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:7854:x1875409185561984:12345-0@lo:502: 00000100:00100000:2.0:1788529705.178461:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:7854:x1875409185561984:12345-0@lo:502: Request processed in 109us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.178467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788529705.178494:0:7854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.178505:0:7854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7854:1875409185561984:0@lo:502: 00000040:00080000:2.0:1788529705.178523:0:7854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788529705.178561:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788529705.178580:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529705.178587:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.178596:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529705.178605:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788529705.178607:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc80f0000 from 5 10000000:01000000:2.0:1788529705.178610:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788529705.178626:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.178632:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.178640:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529705.178652:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562112:0@lo:101: 00000100:00100000:2.0:1788529705.178674:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.178689:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562112 00000100:00100000:2.0:1788529705.178693:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562112 00000100:00100000:2.0:1788529705.178711:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788529705.178716:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185562112:12345-0@lo:101: 00010000:00010000:2.0:1788529705.178723:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.178732:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2e00/0xaa46022e3f18af1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18af14 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529705.179561:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db180 going to sleep for 11 seconds 00010000:00010000:2.0:1788529705.187621:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2e00/0xaa46022e3f18af1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18af14 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.187661:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2e00/0xaa46022e3f18af1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af14 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.187672:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2e00, rc 0) 00000100:00100000:2.0:1788529705.187760:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185562112:12345-0@lo:101: Request processed in 9042us (9083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.187769:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788529705.187913:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562112:0@lo:101: 00010000:00010000:0.0:1788529705.187939:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.187951:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.188076:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562240:0@lo:256: 00000100:00100000:0.0:1788529705.188117:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.188154:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529705.188207:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562240 00000100:00100000:2.0:1788529705.188214:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562240 00000100:00100000:2.0:1788529705.188265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788529705.188274:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185562240:12345-0@lo:256: 20000000:01000000:2.0:1788529705.188295:0:5824:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788529705.188313:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788529705.188317:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788529705.188392:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185562240:12345-0@lo:256: Request processed in 119us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.188399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788529705.188567:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562240:0@lo:256: 10000000:01000000:0.0:1788529705.188613:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788529705.188620:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.188631:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529705.188642:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788529705.188645:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788529705.188648:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788529705.188671:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.188680:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.188689:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.188701:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562368:0@lo:101: 00000100:00100000:0.0:1788529705.188725:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.188749:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.189053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562368 00000100:00100000:3.0:1788529705.189059:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562368 00000100:00100000:3.0:1788529705.189089:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788529705.189098:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185562368:12345-0@lo:101: 00010000:00010000:3.0:1788529705.189107:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529705.189126:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18af22 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.189146:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.189156:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.189164:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529705.189194:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185562368:12345-0@lo:101: Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.189200:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788529705.192312:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562368:0@lo:101: 00010000:00010000:0.0:1788529705.192341:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.192354:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.192694:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562496:0@lo:501: 00000100:00100000:0.0:1788529705.192755:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.192832:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.204589:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562496 00000100:00100000:3.0:1788529705.204604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562496 00000100:00100000:3.0:1788529705.204679:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788529705.204690:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185562496:12345-0@lo:501: 00000100:00100000:3.0:1788529705.205038:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185562496:12345-0@lo:501: Request processed in 349us (12281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.205047:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788529705.205186:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562496:0@lo:501: 00000100:00100000:1.0:1788529705.205250:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562624:0@lo:503: 00000100:00100000:1.0:1788529705.205305:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.205345:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43780 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.207006:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562624 00000100:00100000:3.0:1788529705.207017:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562624 00000100:00100000:3.0:1788529705.207081:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788529705.207092:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185562624:12345-0@lo:503: 00000100:00100000:3.0:1788529705.207621:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185562624:12345-0@lo:503: Request processed in 530us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.207630:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788529705.207723:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185562624:0@lo:503: 00000100:00100000:2.0:1788529705.212759:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7857:1875409185562752:0@lo:502: 00000100:00100000:2.0:1788529705.212840:0:7857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529705.212966:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db840 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.213037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562752 00000100:00100000:0.0:1788529705.213046:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562752 00000100:00100000:0.0:1788529705.213099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788529705.213109:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:7857:x1875409185562752:12345-0@lo:502: 00000100:00100000:0.0:1788529705.213451:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:7857:x1875409185562752:12345-0@lo:502: Request processed in 343us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.213460:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788529705.213664:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7857:1875409185562752:0@lo:502: 00000020:01000000:2.0:1788529705.213699:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788529705.213709:0:7857:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788529705.213717:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529705.213719:0:7857:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788529705.213726:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788529705.213730:0:7857:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:2.0:1788529705.213764:0:7857:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788529705.213768:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788529705.213782:0:7857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cabc2e91988) 00000020:00000080:2.0:1788529705.213809:0:7857:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788529705.213815:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788529705.213938:0:7857:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788529705.213945:0:7857:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788529705.213952:0:7857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18af37 00010000:00080000:2.0:1788529705.213993:0:7857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caac6f62800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1788529705.214235:0:7857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788529705.214756:0:7857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788529705.214769:0:7857:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788529705.219613:0:7857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529705.219928:0:7857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529705.220109:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788529705.220171:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788529705.223431:0:7858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788529705.223440:0:7858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788529705.224350:0:7857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788529705.224365:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788529705.224479:0:7857:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788529705.224507:0:7857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18af3e 00000100:00080000:3.0:1788529705.224521:0:7857:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788529705.224529:0:7857:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8caac6f62800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788529705.224571:0:7857:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabf60c9c00 x1875409185562880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788529705.224596:0:7857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788529705.224655:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788529705.224660:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529705.224662:0:7857:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788529705.224665:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788529705.224669:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529705.224671:0:7857:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788529705.224674:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788529705.224676:0:7857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788529705.224703:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7857:1875409185563008:0@lo:502: 00000100:00100000:3.0:1788529705.224786:0:7857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529705.224823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563008 00000100:00100000:3.0:1788529705.224830:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563008 00000100:00100000:3.0:1788529705.224883:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788529705.224917:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:7857:x1875409185563008:12345-0@lo:502: 00000100:00100000:3.0:1788529705.225378:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:7857:x1875409185563008:12345-0@lo:502: Request processed in 485us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.225388:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788529705.225514:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185562880:0@lo:8: 00000100:00100000:1.0:1788529705.225551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.225637:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185562880 00000100:00100000:0.0:1788529705.225642:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185562880 00000100:00100000:0.0:1788529705.225666:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788529705.225671:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185562880:12345-0@lo:8: 00010000:00080000:0.0:1788529705.225693:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1788529705.225718:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18af45 00002000:00100000:0.0:1788529705.225731:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8caac4dd0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788529705.225735:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788529705.225738:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788529705.225851:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788529705.226182:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788529705.226208:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8caac4dd5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788529705.226256:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875409185562880:12345-0@lo:8: Request processed in 583us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.226263:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788529705.226364:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60c9c00 x1875409185562880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788529715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529705.226374:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788529705.226381:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788529705.226389:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788529705.226394:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788529705.226396:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac6f62800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788529705.226486:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788529705.226492:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185562880:0@lo:8: 00000004:00080000:1.0:1788529705.226515:0:7858:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788529705.226609:0:7858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215196714080ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788529705.226798:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185563264:0@lo:400: 00000100:00100000:3.0:1788529705.226829:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529705.226872:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529705.226880:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185563136:0@lo:400: 00000100:00100000:3.0:1788529705.226930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.227089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563264 00000100:00100000:0.0:1788529705.227094:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563264 00000100:00100000:0.0:1788529705.227139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563136 00000100:00100000:0.0:1788529705.227142:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563136 00000100:00100000:3.0:1788529705.227254:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185563392:0@lo:400: 00000100:00100000:3.0:1788529705.227285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529705.227304:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529705.227310:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185563520:0@lo:400: 00000100:00100000:3.0:1788529705.227328:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788529705.227547:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529705.227568:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563392 00000100:00100000:2.0:1788529705.227572:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563392 00000100:00100000:2.0:1788529705.227607:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788529705.227615:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185563392:12345-0@lo:400: 00000100:00100000:2.0:1788529705.227659:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185563392:12345-0@lo:400: Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.227666:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788529705.230487:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29180 x1875409185563392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.230504:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185563392:0@lo:400: 00000100:00100000:3.0:1788529705.230546:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.230560:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:7857:1875409185563008:0@lo:502: 00000020:01000000:3.0:1788529705.230600:0:7857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788529705.230611:0:7857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529705.230613:0:7857:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788529705.230618:0:7857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788529705.230706:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788529705.230717:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788529705.230728:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.230738:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529705.230750:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788529705.230752:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabc80f0000 from 1 10000000:01000000:3.0:1788529705.230756:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788529705.230804:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.230812:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.230822:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529705.230840:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185563648:0@lo:101: 00000100:00100000:3.0:1788529705.230925:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529705.230951:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.231080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563520 00000100:00100000:0.0:1788529705.231088:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563520 00000100:00100000:0.0:1788529705.231139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788529705.231150:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185563264:12345-0@lo:400: 00000100:00100000:0.0:1788529705.231213:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185563264:12345-0@lo:400: Request processed in 66us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.231221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788529705.231241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788529705.231249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185563136:12345-0@lo:400: 00000100:00100000:0.0:1788529705.231279:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185563136:12345-0@lo:400: Request processed in 31us (4348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.231286:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788529705.231298:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788529705.231304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185563520:12345-0@lo:400: 00000100:00100000:0.0:1788529705.231338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185563520:12345-0@lo:400: Request processed in 34us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529705.231344:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788529705.231561:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce28380 x1875409185563136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.231572:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185563136:0@lo:400: 00010000:00080000:3.0:1788529705.231586:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2b480 x1875409185563264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.231594:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185563264:0@lo:400: 00010000:00080000:3.0:1788529705.231627:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2aa00 x1875409185563520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.231635:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185563520:0@lo:400: 00000100:00080000:2.0:1788529705.231890:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788529705.235967:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529705.235990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563648 00000100:00100000:2.0:1788529705.236002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563648 00000100:00100000:2.0:1788529705.236063:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788529705.236073:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185563648:12345-0@lo:101: 00010000:00010000:2.0:1788529705.236101:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529705.236122:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18af4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.236152:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.236163:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529705.236172:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2000, rc 0) 00000100:00100000:2.0:1788529705.236249:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185563648:12345-0@lo:101: Request processed in 177us (5322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529705.236256:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788529705.242390:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185563648:0@lo:101: 00010000:00010000:0.0:1788529705.242495:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.242509:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529705.242970:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185563776:0@lo:501: 00000100:00100000:0.0:1788529705.243060:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.243097:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.243193:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563776 00000100:00100000:3.0:1788529705.243201:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563776 00000100:00100000:3.0:1788529705.243250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788529705.243262:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185563776:12345-0@lo:501: 00000100:00100000:3.0:1788529705.243566:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185563776:12345-0@lo:501: Request processed in 306us (505us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529705.243579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788529705.243619:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185563776:0@lo:501: 10000000:01000000:3.0:1788529705.243633:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529705.243639:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529705.243648:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529705.302159:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788529705.302603:0:7859:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788529705.302632:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564032:0@lo:7: 00000100:00100000:0.0:1788529705.302703:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.302732:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d543c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788529705.302756:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788529705.302787:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185563904:0@lo:13: 00000100:00100000:0.0:1788529705.302815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.302870:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564032 00000100:00100000:0.0:1788529705.302876:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564032 00000100:00100000:0.0:1788529705.304191:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788529705.304204:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875409185564032:12345-0@lo:7: 00000100:00100000:3.0:1788529705.311612:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185563904 00000100:00100000:3.0:1788529705.311629:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185563904 00000100:00100000:3.0:1788529705.312951:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788529705.313237:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875409185563904:12345-0@lo:13: 00002000:00000024:3.0:1788529705.313281:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:0.0:1788529705.318005:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529705.327541:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875409185563904:12345-0@lo:13: Request processed in 14301us (24713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.327556:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788529705.330368:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29500 x1875409185563904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529705.330399:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185563904:0@lo:13: 00002000:00080000:1.0:1788529705.331801:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788529705.331810:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788529705.331932:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875409185564032:12345-0@lo:7: Request processed in 27727us (29224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529705.331945:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788529705.332043:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29f80 x1875409185564032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788529721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529705.332058:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564032:0@lo:7: 00000004:00080000:0.0:1788529705.332072:0:7859:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788529705.332186:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564160:0@lo:5: 00000100:00100000:0.0:1788529705.332233:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.332289:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.332347:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564160 00000100:00100000:3.0:1788529705.332354:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564160 00000100:00100000:3.0:1788529705.332412:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788529705.332423:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7859:x1875409185564160:12345-0@lo:5: 00002000:00080000:3.0:1788529705.332450:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788529705.332454:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788529705.332763:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7859:x1875409185564160:12345-0@lo:5: Request processed in 342us (528us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788529705.332771:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788529705.333247:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29f80 x1875409185564160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788529721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529705.333263:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564160:0@lo:5: 00000004:00080000:0.0:1788529705.333274:0:7859:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788529705.333303:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564288:0@lo:700: 00000100:00100000:0.0:1788529705.333336:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.333363:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529705.334270:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564288 00000100:00100000:1.0:1788529705.334280:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564288 00000100:00100000:1.0:1788529705.334333:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529705.334341:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7859:x1875409185564288:12345-0@lo:700: 00000100:00100000:1.0:1788529705.334385:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875409185564416:0@lo:700: 00000100:00100000:1.0:1788529705.335293:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529705.335322:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5c43240 going to sleep for 11 seconds 00000100:00100000:3.0:1788529705.335434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564416 00000100:00100000:3.0:1788529705.335447:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564416 00000100:00100000:3.0:1788529705.335610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529705.335619:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875409185564416:12345-0@lo:700: 40000000:02000000:3.0:1788529705.400996:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788529705.423233:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875409185564416:12345-0@lo:700: Request processed in 87607us (87933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529705.423247:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788529705.424000:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2f480 x1875409185564416/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788529721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529705.424017:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875409185564416:0@lo:700: 40000000:02000000:1.0:1788529705.424036:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788529705.557552:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7859:x1875409185564288:12345-0@lo:700: Request processed in 223202us (224205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529705.557566:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1788529705.557923:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788529705.557948:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:0.0:1788529705.558001:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2b480 x1875409185564288/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788529721 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529705.558018:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564288:0@lo:700: 00000004:02000040:0.0:1788529705.651586:0:7859:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788529705.659710:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564544:0@lo:5: 00000100:00100000:0.0:1788529705.659788:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529705.659837:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529705.659871:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564544 00000100:00100000:0.0:1788529705.659877:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564544 00000100:00100000:0.0:1788529705.660017:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788529705.660028:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7859:x1875409185564544:12345-0@lo:5: 00002000:00080000:1.0:1788529705.676222:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788529705.676241:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788529705.691034:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7859:x1875409185564544:12345-0@lo:5: Request processed in 30998us (31236us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788529705.691048:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788529705.691593:0:7859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2b480 x1875409185564544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788529721 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.691608:0:7859:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788529705.691624:0:7859:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cabfce2b480 x1875409185564544/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788529721 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529705.691636:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7859:1875409185564544:0@lo:5: 00000004:00080000:3.0:1788529705.691652:0:7859:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788529706.320575:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529707.349850:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529707.620765:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185564672:0@lo:13: 00000100:00100000:3.0:1788529707.620857:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529707.620955:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564672 00000100:00100000:3.0:1788529707.620962:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564672 00000100:00100000:3.0:1788529707.621018:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788529707.621028:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185564672:12345-0@lo:13: 00002000:00000024:3.0:1788529707.623233:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529707.623318:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185564672:12345-0@lo:13: Request processed in 2288us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529707.623329:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788529707.623360:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529707.625304:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60cbb80 x1875409185564672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529707.625336:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185564672:0@lo:13: 00010000:00010000:1.0:1788529708.365255:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529708.649535:0:7994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788529709.391596:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529710.413994:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529710.669284:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185565056:0@lo:400: 00000100:00100000:2.0:1788529710.669318:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185564928:0@lo:400: 00000100:00100000:1.0:1788529710.669404:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185564800:0@lo:400: 00000100:00100000:2.0:1788529710.674241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529710.674526:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185565440:0@lo:400: 00000100:00100000:2.0:1788529710.674589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529710.674670:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565440 00000100:00100000:2.0:1788529710.674680:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565440 00000100:00100000:2.0:1788529710.674769:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529710.674782:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185565440:12345-0@lo:400: 00000100:00100000:2.0:1788529710.674847:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185565440:12345-0@lo:400: Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529710.674854:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788529710.674878:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788529710.674939:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc720000 x1875409185565440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529710.676169:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185565440:0@lo:400: 00000100:00100000:1.0:1788529710.678374:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529710.678450:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185565312:0@lo:400: 00000100:00100000:1.0:1788529710.678497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529710.678547:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564928 00000100:00100000:1.0:1788529710.678556:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564928 00000100:00100000:1.0:1788529710.678601:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565312 00000100:00100000:1.0:1788529710.678604:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565312 00000100:00100000:1.0:1788529710.678632:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529710.678641:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185564928:12345-0@lo:400: 00000100:00100000:1.0:1788529710.678697:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185564928:12345-0@lo:400: Request processed in 58us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529710.678705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529710.678722:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788529710.678728:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185565312:12345-0@lo:400: 00000100:00100000:2.0:1788529710.678843:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185564800 00000100:00100000:2.0:1788529710.678849:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185564800 00000100:00100000:2.0:1788529710.678881:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788529710.678887:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185564800:12345-0@lo:400: 00000100:00100000:2.0:1788529710.679483:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185564800:12345-0@lo:400: Request processed in 595us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529710.679490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788529710.679520:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788529710.679560:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29880 x1875409185564928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529710.679574:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185564928:0@lo:400: 00000100:00100000:3.0:1788529710.680976:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185565184:0@lo:400: 00000100:00100000:3.0:1788529710.681033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529710.681067:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529710.681074:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185565568:0@lo:13: 00000100:00100000:3.0:1788529710.681099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529710.682273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529710.682327:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565056 00000100:00100000:2.0:1788529710.682328:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565568 00000100:00100000:2.0:1788529710.682338:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565568 00000100:00100000:0.0:1788529710.682338:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565056 00000100:00100000:0.0:1788529710.682385:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529710.682391:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788529710.682394:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185565056:12345-0@lo:400: 00000100:00100000:2.0:1788529710.682397:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185565568:12345-0@lo:13: 00002000:00000024:2.0:1788529710.682427:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529710.682444:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185565056:12345-0@lo:400: Request processed in 53us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529710.682452:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529710.682463:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185565568:12345-0@lo:13: Request processed in 66us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529710.682468:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788529710.682475:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788529710.683104:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce29f80 x1875409185565056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529710.683120:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185565056:0@lo:400: 00010000:00080000:2.0:1788529710.683607:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60cbb80 x1875409185565568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529710.683629:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185565568:0@lo:13: 00000100:00100000:1.0:1788529710.686829:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185565312:12345-0@lo:400: Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529710.686857:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788529710.686918:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565184 00000100:00100000:1.0:1788529710.686928:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565184 00000100:00100000:1.0:1788529710.686988:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788529710.686998:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185565184:12345-0@lo:400: 00000100:00100000:1.0:1788529710.687110:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185565184:12345-0@lo:400: Request processed in 113us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529710.687117:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788529710.689732:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185564800:0@lo:400: 00000100:00080000:1.0:1788529710.690049:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788529710.703869:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc721180 x1875409185565312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529710.703889:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185565312:0@lo:400: 00010000:00080000:0.0:1788529710.706621:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc721500 x1875409185565184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529710.706643:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185565184:0@lo:400: 00000001:00080000:0.0:1788529710.783194:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788529711.437491:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529712.467121:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529712.725521:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529712.725547:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185565696:0@lo:13: 00000100:00100000:2.0:1788529712.725633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529712.725707:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565696 00000100:00100000:2.0:1788529712.725716:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565696 00000100:00100000:2.0:1788529712.725797:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529712.725807:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185565696:12345-0@lo:13: 00002000:00000024:2.0:1788529712.725838:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529712.725880:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185565696:12345-0@lo:13: Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529712.725887:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788529712.725931:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529712.725962:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc2e85880 x1875409185565696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529712.725981:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185565696:0@lo:13: 00010000:00010000:1.0:1788529713.485350:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529714.514340:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529715.535115:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529715.789505:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529715.789531:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185565824:0@lo:13: 00000100:00100000:2.0:1788529715.789593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529715.789658:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565824 00000100:00100000:2.0:1788529715.789666:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565824 00000100:00100000:2.0:1788529715.789799:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788529715.789807:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185565824:12345-0@lo:13: 00002000:00000024:2.0:1788529715.789838:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529715.789875:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185565824:12345-0@lo:13: Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529715.789882:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788529715.789923:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788529715.789957:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc2e85880 x1875409185565824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529715.789984:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788529715.790007:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185565824:0@lo:13: 00000100:00100000:0.0:1788529715.791346:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185565952:0@lo:400: 00000100:00100000:0.0:1788529715.791403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529715.791448:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185566464:0@lo:400: 00000100:00100000:0.0:1788529715.791482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529715.791512:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788529715.791519:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185566336:0@lo:400: 00000100:00100000:0.0:1788529715.791560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529715.791592:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185566080:0@lo:400: 00000100:00100000:0.0:1788529715.791622:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529715.791655:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529715.791661:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185566208:0@lo:400: 00000100:00100000:0.0:1788529715.791695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529715.791735:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185565952 00000100:00100000:0.0:1788529715.791742:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185565952 00000100:00100000:0.0:1788529715.791789:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788529715.791800:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185565952:12345-0@lo:400: 00000100:00100000:0.0:1788529715.791847:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185565952:12345-0@lo:400: Request processed in 49us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529715.791855:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788529715.791891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566464 00000100:00100000:0.0:1788529715.791920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566464 00000100:00100000:0.0:1788529715.791959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566080 00000100:00100000:0.0:1788529715.791963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566080 00000100:00100000:0.0:1788529715.791975:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566208 00000100:00100000:0.0:1788529715.791978:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566208 00000100:00100000:0.0:1788529715.791995:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788529715.792002:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185566464:12345-0@lo:400: 00000100:00100000:0.0:1788529715.792038:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185566464:12345-0@lo:400: Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529715.792046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788529715.792062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529715.792068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185566080:12345-0@lo:400: 00000100:00100000:0.0:1788529715.792104:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185566080:12345-0@lo:400: Request processed in 37us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529715.792120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529715.792140:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788529715.792149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185566208:12345-0@lo:400: 00000100:00100000:0.0:1788529715.792182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185566208:12345-0@lo:400: Request processed in 35us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529715.792188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788529715.792215:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566336 00000100:00100000:0.0:1788529715.792219:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566336 00000100:00100000:0.0:1788529715.792256:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788529715.792264:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185566336:12345-0@lo:400: 00000100:00100000:0.0:1788529715.792297:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185566336:12345-0@lo:400: Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529715.792303:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788529715.792348:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc720380 x1875409185566336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529715.792362:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185566336:0@lo:400: 00000100:00100000:0.0:1788529715.792374:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185565952:0@lo:400: 00010000:00080000:0.0:1788529715.792384:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc721c00 x1875409185566464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529715.792392:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185566464:0@lo:400: 00000100:00080000:0.0:1788529715.792418:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529715.792424:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788529715.792446:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc720700 x1875409185566208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529715.792456:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185566208:0@lo:400: 00010000:00080000:0.0:1788529715.792481:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc721180 x1875409185566080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529715.792490:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185566080:0@lo:400: 00000100:00100000:1.0:1788529716.246285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529716.247742:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275200 00000100:00100000:1.0:1788529716.247754:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275200 00000100:00100000:1.0:1788529716.248313:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1788529716.248340:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875409158275200:12345-192.168.201.52@tcp:250: 00010000:00080000:1.0:1788529716.248382:0:5824:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 6bccf9d7-1f26-4f23-8349-edc335a13477@192.168.201.52@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1788529716.248462:0:5824:0:(genops.c:1385:class_connect()) connect: client 6bccf9d7-1f26-4f23-8349-edc335a13477, cookie 0xaa46022e3f18af5a 00000100:00080000:1.0:1788529716.249726:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8caac437c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788529716.250129:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+5:2353:x1875409158275200:12345-192.168.201.52@tcp:250: Request processed in 1471us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529716.250142:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:3.0:1788529716.277565:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.277846:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275328 00000100:00100000:0.0:1788529716.277857:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275328 00000100:00100000:0.0:1788529716.277938:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:0.0:1788529716.277949:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+5:5586:x1875409158275328:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1788529716.277967:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529716.277987:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0c5f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.278020:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.278033:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.278042:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfe00, rc 0) 00000100:00100000:0.0:1788529716.278325:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+6:5586:x1875409158275328:12345-192.168.201.52@tcp:101: Request processed in 160us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.278455:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:3.0:1788529716.279407:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529716.283507:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275456 00000100:00100000:1.0:1788529716.283522:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275456 00000100:00100000:1.0:1788529716.283587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:1.0:1788529716.283600:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+6:5586:x1875409158275456:12345-192.168.201.52@tcp:501: 00000100:00100000:1.0:1788529716.284307:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+6:5586:x1875409158275456:12345-192.168.201.52@tcp:501: Request processed in 707us (4901us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529716.284317:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:3.0:1788529716.286607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529716.286713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275584 00000100:00100000:2.0:1788529716.286723:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275584 00000100:00100000:2.0:1788529716.286776:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:2.0:1788529716.286786:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+6:5586:x1875409158275584:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1788529716.286801:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529716.286820:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0c66 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529716.286849:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529716.286860:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529716.286870:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2400, rc 0) 00000100:00100000:2.0:1788529716.286955:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+7:5586:x1875409158275584:12345-192.168.201.52@tcp:101: Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529716.286962:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:3.0:1788529716.292450:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.292642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275712 00000100:00100000:0.0:1788529716.292653:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275712 00000100:00100000:0.0:1788529716.292725:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1788529716.292737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+7:5586:x1875409158275712:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1788529716.294312:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5586:x1875409158275712:12345-192.168.201.52@tcp:501: Request processed in 1569us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.294334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:2.0:1788529716.299814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529716.299986:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275840 00000100:00100000:3.0:1788529716.299997:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275840 00000100:00100000:3.0:1788529716.300056:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1788529716.300068:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5586:x1875409158275840:12345-192.168.201.52@tcp:503: 00000100:00100000:3.0:1788529716.300961:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5586:x1875409158275840:12345-192.168.201.52@tcp:503: Request processed in 890us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529716.300971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:2.0:1788529716.318681:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.318857:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158275968 00000100:00100000:0.0:1788529716.318869:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158275968 00000100:00100000:0.0:1788529716.318943:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:0.0:1788529716.318955:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5605:x1875409158275968:12345-192.168.201.52@tcp:502: 00000100:00100000:0.0:1788529716.319346:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5605:x1875409158275968:12345-192.168.201.52@tcp:502: Request processed in 392us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.319356:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:1.0:1788529716.366296:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529716.366348:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276096 00000100:00100000:1.0:1788529716.366358:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276096 00000100:00100000:1.0:1788529716.366409:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:1.0:1788529716.366420:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5605:x1875409158276096:12345-192.168.201.52@tcp:502: 00000100:00100000:1.0:1788529716.366727:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5605:x1875409158276096:12345-192.168.201.52@tcp:502: Request processed in 307us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529716.366742:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1788529716.378457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.378515:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276224 00000100:00100000:0.0:1788529716.378527:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276224 00000100:00100000:0.0:1788529716.378591:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1788529716.378603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5586:x1875409158276224:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1788529716.378624:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529716.378645:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61dfc00/0xaa46022e3f18af6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0c90 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.378690:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61dfc00/0xaa46022e3f18af6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c90 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.378712:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61dfc00/0xaa46022e3f18af6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c90 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.378721:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfc00, rc 0) 00000100:00100000:0.0:1788529716.378796:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5586:x1875409158276224:12345-192.168.201.52@tcp:101: Request processed in 195us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.378803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1788529716.387948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529716.389481:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276352 00000100:00100000:1.0:1788529716.389493:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276352 00000100:00100000:1.0:1788529716.389565:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:1.0:1788529716.389576:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5586:x1875409158276352:12345-192.168.201.52@tcp:256: 20000000:01000000:1.0:1788529716.389603:0:5822:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788529716.389628:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788529716.389633:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788529716.389637:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788529716.389639:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788529716.397745:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5586:x1875409158276352:12345-192.168.201.52@tcp:256: Request processed in 8158us (9798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529716.397761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:3.0:1788529716.408466:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.408743:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276480 00000100:00100000:0.0:1788529716.408754:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276480 00000100:00100000:0.0:1788529716.408808:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:0.0:1788529716.408826:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5586:x1875409158276480:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1788529716.408844:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529716.408862:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0c97 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.409081:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.409096:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529716.409106:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de200, rc 0) 00000100:00100000:0.0:1788529716.409156:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5586:x1875409158276480:12345-192.168.201.52@tcp:101: Request processed in 332us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.409163:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:2.0:1788529716.415205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529716.415540:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276608 00000100:00100000:3.0:1788529716.415552:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276608 00000100:00100000:3.0:1788529716.415611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:3.0:1788529716.415625:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5586:x1875409158276608:12345-192.168.201.52@tcp:501: 00000100:00100000:3.0:1788529716.416135:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5586:x1875409158276608:12345-192.168.201.52@tcp:501: Request processed in 510us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529716.416145:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:2.0:1788529716.425451:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.439831:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276736 00000100:00100000:0.0:1788529716.439849:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276736 00000100:00100000:0.0:1788529716.439928:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:0.0:1788529716.439940:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5586:x1875409158276736:12345-192.168.201.52@tcp:503: 00000100:00100000:0.0:1788529716.440864:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5586:x1875409158276736:12345-192.168.201.52@tcp:503: Request processed in 863us (15361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.440876:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:0.0:1788529716.459096:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529716.459481:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276864 00000100:00100000:3.0:1788529716.459495:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276864 00000100:00100000:3.0:1788529716.459579:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:3.0:1788529716.459592:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5610:x1875409158276864:12345-192.168.201.52@tcp:502: 00000100:00100000:3.0:1788529716.460706:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5610:x1875409158276864:12345-192.168.201.52@tcp:502: Request processed in 1108us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529716.460719:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:0.0:1788529716.481467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529716.482040:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158276992 00000100:00100000:3.0:1788529716.482054:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158276992 00000100:00100000:3.0:1788529716.482129:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:3.0:1788529716.482141:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5610:x1875409158276992:12345-192.168.201.52@tcp:502: 00000100:00100000:3.0:1788529716.482486:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5610:x1875409158276992:12345-192.168.201.52@tcp:502: Request processed in 345us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529716.482496:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:2.0:1788529716.490210:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529716.491243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277120 00000100:00100000:0.0:1788529716.491287:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277120 00000100:00100000:0.0:1788529716.491362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1788529716.491374:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875409158277120:12345-192.168.201.52@tcp:38: 00010000:00080000:0.0:1788529716.491418:0:5831:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1788529716.491497:0:5831:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18af7d 00000004:00100000:0.0:1788529716.491553:0:5831:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788529716.491565:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788529716.559856:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788529716.602647:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8caac4dd6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788529716.603443:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158277120:12345-192.168.201.52@tcp:38: Request processed in 112062us (113235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529716.603462:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00010000:00010000:1.0:1788529717.581198:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529717.637934:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529717.638211:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277376 00000100:00100000:2.0:1788529717.638231:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277376 00000100:00100000:2.0:1788529717.638383:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1788529717.638399:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277376:12345-192.168.201.52@tcp:41: 00000004:00000024:2.0:1788529717.638467:0:7603:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788529717.638569:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277376:12345-192.168.201.52@tcp:41: Request processed in 173us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529717.638578:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00080000:0.0:1788529717.639396:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529717.642417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529717.642531:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529717.646536:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277248 00000100:00100000:1.0:1788529717.646555:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277248 00000100:00100000:1.0:1788529717.646647:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277504 00000100:00100000:1.0:1788529717.646651:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277504 00000100:00100000:1.0:1788529717.646729:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1788529717.646743:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:0:x1875409158277248:12345-192.168.201.52@tcp:41: 00000004:00000024:1.0:1788529717.646789:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788529717.647204:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:0:x1875409158277248:12345-192.168.201.52@tcp:41: Request processed in 463us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529717.647212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1788529717.647234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1788529717.647241:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277504:12345-192.168.201.52@tcp:40: 00000100:00100000:1.0:1788529717.647285:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277504:12345-192.168.201.52@tcp:40: Request processed in 44us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529717.647292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788529717.651105:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529717.651152:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529717.651191:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529717.651224:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529717.651280:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277888 00000100:00100000:3.0:1788529717.651292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277888 00000100:00100000:3.0:1788529717.651355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788529717.651367:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277888:12345-192.168.201.52@tcp:33: 00000100:00100000:3.0:1788529717.651506:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277632 00000100:00100000:3.0:1788529717.651510:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277632 00000100:00100000:3.0:1788529717.651533:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158277760 00000100:00100000:3.0:1788529717.651536:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158277760 00000100:00100000:3.0:1788529717.651551:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1788529717.651557:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158277632:12345-192.168.201.52@tcp:8: 00010000:00080000:3.0:1788529717.651587:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788529717.651628:0:6688:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18af84 00002000:00100000:3.0:1788529717.651656:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14b4f045-1109-44f4-a991-3ed448c68aea/ffff8cabc61f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788529717.651688:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788529717.652186:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788529717.652229:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cabc61f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529717.652332:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158277632:12345-192.168.201.52@tcp:8: Request processed in 772us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529717.652341:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1788529717.652365:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788529717.652370:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158277760:12345-192.168.201.52@tcp:8: 00010000:00080000:3.0:1788529717.652389:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788529717.652411:0:6688:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18af8b 00002000:00100000:3.0:1788529717.652419:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14b4f045-1109-44f4-a991-3ed448c68aea/ffff8cabc61f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788529717.652439:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788529717.652703:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788529717.652720:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cabc61f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529717.652748:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158277760:12345-192.168.201.52@tcp:8: Request processed in 376us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529717.652768:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1788529717.653874:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278016 00000100:00100000:1.0:1788529717.653889:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278016 00000100:00100000:1.0:1788529717.653975:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:1.0:1788529717.653985:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2357:x1875409158278016:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1788529717.654058:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2357:x1875409158278016:12345-192.168.201.52@tcp:400: Request processed in 75us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529717.654066:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000004:00080000:0.0:1788529717.684187:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32703us 00000004:00200000:0.0:1788529717.699283:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788529717.699449:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:5586:x1875409158277888:12345-192.168.201.52@tcp:33: Request processed in 48077us (48354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529717.699468:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1788529717.837675:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185566592:0@lo:13: 00000100:00100000:1.0:1788529717.837797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529717.839736:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566592 00000100:00100000:2.0:1788529717.839753:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566592 00000100:00100000:2.0:1788529717.839858:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788529717.839870:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185566592:12345-0@lo:13: 00002000:00000024:2.0:1788529717.839934:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529717.840048:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185566592:12345-0@lo:13: Request processed in 179us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529717.840055:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788529717.840190:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529717.840241:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc83800 x1875409185566592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529717.840265:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185566592:0@lo:13: 00000100:00100000:0.0:1788529717.943740:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529717.949210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278144 00000100:00100000:3.0:1788529717.949240:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278144 00000100:00100000:3.0:1788529717.949358:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1788529717.949372:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:5628:x1875409158278144:12345-192.168.201.52@tcp:101: 00010000:00010000:3.0:1788529717.949401:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529717.949438:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7200/0xaa46022e3f18af92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0cc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949531:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949548:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949567:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529717.949612:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529717.949616:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529717.949652:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949686:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7200/0xaa46022e3f18af92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc1 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949710:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc1 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529717.949747:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:3.0:1788529717.949751:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529717.949756:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529717.949891:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:5628:x1875409158278144:12345-192.168.201.52@tcp:101: Request processed in 521us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529717.949959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000001:00100000:0.0:1788529717.984765:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00010000:00010000:3.0:1788529718.606655:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529719.630474:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529720.426921:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529720.427393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278272 00000100:00100000:2.0:1788529720.427409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278272 00000100:00100000:2.0:1788529720.427521:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1788529720.427536:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:5680:x1875409158278272:12345-192.168.201.52@tcp:41: 00000004:00000024:2.0:1788529720.427613:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788529720.427719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:5680:x1875409158278272:12345-192.168.201.52@tcp:41: Request processed in 186us (845us total) trans 0 rc 0/0 00000100:00080000:1.0:1788529720.427879:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529720.428051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1788529720.430845:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529720.430976:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278400 00000100:00100000:2.0:1788529720.430989:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278400 00000100:00080000:1.0:1788529720.431140:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529720.431300:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1788529720.431315:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14b4f045-1109-44f4-a991-3ed448c68aea+5:5680:x1875409158278400:12345-192.168.201.52@tcp:13: 00002000:00000024:2.0:1788529720.431381:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529720.431511:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14b4f045-1109-44f4-a991-3ed448c68aea+5:5680:x1875409158278400:12345-192.168.201.52@tcp:13: Request processed in 200us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.431520:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1788529720.447534:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529720.447701:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278528 00000100:00100000:2.0:1788529720.447716:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278528 00000100:00100000:2.0:1788529720.447829:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1788529720.447846:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14b4f045-1109-44f4-a991-3ed448c68aea+6:5680:x1875409158278528:12345-192.168.201.52@tcp:13: 00002000:00000024:2.0:1788529720.447927:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529720.448011:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14b4f045-1109-44f4-a991-3ed448c68aea+6:5680:x1875409158278528:12345-192.168.201.52@tcp:13: Request processed in 169us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.448019:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00080000:1.0:1788529720.448132:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788529720.653795:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529720.909647:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529720.909697:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185566720:0@lo:13: 00000100:00100000:1.0:1788529720.909836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529720.910348:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566720 00000100:00100000:2.0:1788529720.910514:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566720 00000100:00100000:2.0:1788529720.913251:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788529720.913284:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185566720:12345-0@lo:13: 00002000:00000024:2.0:1788529720.913333:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529720.913408:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185566848:0@lo:400: 00000100:00080000:1.0:1788529720.913523:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529720.913570:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185566976:0@lo:400: 00000100:00100000:2.0:1788529720.915317:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185566720:12345-0@lo:13: Request processed in 2041us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.915331:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788529720.915448:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185567232:0@lo:400: 00000100:00100000:2.0:1788529720.915503:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529720.915549:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788529720.915556:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185567104:0@lo:400: 00000100:00100000:2.0:1788529720.915602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529720.915647:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567232 00000100:00100000:2.0:1788529720.915659:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567232 00000100:00100000:2.0:1788529720.915729:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529720.915739:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185567232:12345-0@lo:400: 00000100:00100000:2.0:1788529720.915807:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185567232:12345-0@lo:400: Request processed in 70us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.915814:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788529720.915836:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567104 00000100:00100000:2.0:1788529720.915840:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567104 00000100:00100000:2.0:1788529720.915875:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788529720.915882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185567104:12345-0@lo:400: 00000100:00100000:2.0:1788529720.915942:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185567104:12345-0@lo:400: Request processed in 60us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.915949:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788529720.916023:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185567104:0@lo:400: 00010000:00080000:2.0:1788529720.916038:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc721880 x1875409185567232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529720.916048:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185567232:0@lo:400: 00010000:00080000:2.0:1788529720.916102:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc2e86a00 x1875409185566720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529720.919257:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185566720:0@lo:13: 00000100:00080000:2.0:1788529720.921515:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788529720.921534:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529720.924310:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529720.924404:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185567360:0@lo:400: 00000100:00100000:0.0:1788529720.924504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529720.924620:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567360 00000100:00100000:0.0:1788529720.924635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567360 00000100:00100000:0.0:1788529720.924717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529720.924728:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185567360:12345-0@lo:400: 00000100:00100000:0.0:1788529720.924804:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185567360:12345-0@lo:400: Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529720.924813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788529720.924842:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529720.924886:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185567360:0@lo:400: 00000100:00100000:2.0:1788529720.925809:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566848 00000100:00100000:2.0:1788529720.925819:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566848 00000100:00100000:2.0:1788529720.925925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788529720.925937:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185566848:12345-0@lo:400: 00000100:00100000:2.0:1788529720.926036:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185566848:12345-0@lo:400: Request processed in 101us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.926045:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788529720.927614:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185566848:0@lo:400: 00000100:00100000:1.0:1788529720.934968:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529720.935077:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185566976 00000100:00100000:2.0:1788529720.935095:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185566976 00000100:00100000:2.0:1788529720.935259:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788529720.935278:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185566976:12345-0@lo:400: 00000100:00100000:2.0:1788529720.935477:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185566976:12345-0@lo:400: Request processed in 203us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529720.935486:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788529720.935648:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185566976:0@lo:400: 00010000:00010000:1.0:1788529721.678142:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788529722.033678:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000001:00100000:2.0:1788529722.589480:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00010000:00010000:3.0:1788529722.701226:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529722.962375:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185567488:0@lo:13: 00000100:00100000:0.0:1788529722.962486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529722.962977:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567488 00000100:00100000:3.0:1788529722.962989:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567488 00000100:00100000:3.0:1788529722.963082:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529722.963096:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185567488:12345-0@lo:13: 00002000:00000024:3.0:1788529722.963147:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529722.963221:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185567488:12345-0@lo:13: Request processed in 128us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529722.963229:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788529722.963277:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc81180 x1875409185567488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529722.963300:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185567488:0@lo:13: 00000100:00080000:0.0:1788529722.963800:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529723.160321:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529723.160378:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529723.160472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278784 00000100:00100000:2.0:1788529723.160485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278784 00000100:00100000:2.0:1788529723.160589:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1788529723.160603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158278784:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1788529723.160718:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158278784:12345-192.168.201.52@tcp:400: Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529723.160727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00080000:2.0:1788529723.160760:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529723.161585:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529723.161620:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529723.164771:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278656 00000100:00100000:0.0:1788529723.164806:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278656 00000100:00100000:0.0:1788529723.164920:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:0.0:1788529723.164938:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158278656:12345-192.168.201.52@tcp:400: 00000100:00100000:0.0:1788529723.165051:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158278656:12345-192.168.201.52@tcp:400: Request processed in 116us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529723.165059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:1.0:1788529723.168587:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279040 00000100:00100000:1.0:1788529723.168611:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279040 00000100:00100000:3.0:1788529723.168824:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158278912 00000100:00100000:3.0:1788529723.168830:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158278912 00000100:00100000:3.0:1788529723.168877:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788529723.168891:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158279040:12345-192.168.201.52@tcp:400: 00000100:00100000:3.0:1788529723.169026:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158279040:12345-192.168.201.52@tcp:400: Request processed in 139us (8646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529723.169034:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788529723.169054:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788529723.169061:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158278912:12345-192.168.201.52@tcp:400: 00000100:00100000:3.0:1788529723.169087:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158278912:12345-192.168.201.52@tcp:400: Request processed in 26us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529723.169093:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00080000:1.0:1788529723.170049:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529723.170056:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788529723.734338:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788529723.975726:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788529724.751633:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529725.773295:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529726.032402:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185567744:0@lo:400: 00000100:00100000:3.0:1788529726.032519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032592:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185568256:0@lo:400: 00000100:00100000:3.0:1788529726.032623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032661:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788529726.032668:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185567616:0@lo:400: 00000100:00100000:3.0:1788529726.032701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032724:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185568128:0@lo:400: 00000100:00100000:3.0:1788529726.032747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032780:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185567872:0@lo:400: 00000100:00100000:3.0:1788529726.032809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032840:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529726.032846:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185568000:0@lo:400: 00000100:00100000:3.0:1788529726.032871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529726.032944:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567744 00000100:00100000:3.0:1788529726.032956:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567744 00000100:00100000:3.0:1788529726.033023:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568128 00000100:00100000:3.0:1788529726.033026:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568128 00000100:00100000:3.0:1788529726.033056:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567872 00000100:00100000:3.0:1788529726.033059:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567872 00000100:00100000:3.0:1788529726.033084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529726.033096:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185567744:12345-0@lo:400: 00000100:00100000:3.0:1788529726.033239:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185567744:12345-0@lo:400: Request processed in 144us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529726.033249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529726.033270:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529726.033277:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185568128:12345-0@lo:400: 00000100:00100000:3.0:1788529726.033305:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185568128:12345-0@lo:400: Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529726.033312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529726.033323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529726.033329:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185567872:12345-0@lo:400: 00000100:00100000:3.0:1788529726.033361:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185567872:12345-0@lo:400: Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529726.033368:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529726.033388:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568256 00000100:00100000:3.0:1788529726.033393:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568256 00000100:00100000:3.0:1788529726.033422:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568000 00000100:00100000:3.0:1788529726.033425:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568000 00000100:00100000:3.0:1788529726.033442:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529726.033456:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185568256:12345-0@lo:400: 00000100:00100000:3.0:1788529726.033500:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185568256:12345-0@lo:400: Request processed in 35us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529726.033507:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529726.033521:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529726.033527:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185568000:12345-0@lo:400: 00000100:00100000:3.0:1788529726.033558:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185568000:12345-0@lo:400: Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529726.033565:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788529726.033600:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529726.033605:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529726.033608:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788529726.033648:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc80000 x1875409185568000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529726.033668:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185568000:0@lo:400: 00000100:00100000:3.0:1788529726.033681:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185567872:0@lo:400: 00000100:00100000:3.0:1788529726.033724:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185568128:0@lo:400: 00000100:00100000:3.0:1788529726.033735:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185567744:0@lo:400: 00010000:00080000:3.0:1788529726.033745:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc83800 x1875409185568256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529726.033755:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185568256:0@lo:400: 00000100:00100000:0.0:1788529726.034264:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185567616 00000100:00100000:0.0:1788529726.034273:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185567616 00000100:00100000:0.0:1788529726.034316:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788529726.034326:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185567616:12345-0@lo:400: 00000100:00100000:0.0:1788529726.034385:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185567616:12345-0@lo:400: Request processed in 61us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529726.034400:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788529726.034454:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185567616:0@lo:400: 00000100:00100000:2.0:1788529726.037833:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529726.037881:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185568384:0@lo:13: 00000100:00100000:2.0:1788529726.038174:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529726.038242:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568384 00000100:00100000:2.0:1788529726.038252:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568384 00000100:00100000:2.0:1788529726.038328:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788529726.038339:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185568384:12345-0@lo:13: 00002000:00000024:2.0:1788529726.038393:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529726.038449:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185568384:12345-0@lo:13: Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529726.038458:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788529726.038525:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc720380 x1875409185568384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529726.038549:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185568384:0@lo:13: 00010000:00010000:3.0:1788529726.797394:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529727.825088:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529728.077124:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529728.077161:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185568512:0@lo:13: 00000100:00100000:1.0:1788529728.077258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529728.077473:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568512 00000100:00100000:3.0:1788529728.077484:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568512 00000100:00100000:3.0:1788529728.077567:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788529728.077598:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185568512:12345-0@lo:13: 00002000:00000024:3.0:1788529728.077645:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529728.077726:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185568512:12345-0@lo:13: Request processed in 132us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529728.077735:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788529728.077788:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c2d80 x1875409185568512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529728.077809:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185568512:0@lo:13: 00000100:00080000:1.0:1788529728.079034:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529728.284402:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529728.284461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529728.284505:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529728.284535:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529728.284563:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279168 00000100:00100000:1.0:1788529728.284576:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279168 00000100:00100000:1.0:1788529728.284639:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:1.0:1788529728.284652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2357:x1875409158279168:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1788529728.284749:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2357:x1875409158279168:12345-192.168.201.52@tcp:400: Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529728.284758:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:2.0:1788529728.284933:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279552 00000100:00100000:2.0:1788529728.284939:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279552 00000100:00100000:2.0:1788529728.284983:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279424 00000100:00100000:2.0:1788529728.284987:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279424 00000100:00100000:2.0:1788529728.285008:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1788529728.285015:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158279552:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1788529728.285052:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158279552:12345-192.168.201.52@tcp:400: Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.285060:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1788529728.285080:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1788529728.285086:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158279424:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1788529728.285125:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158279424:12345-192.168.201.52@tcp:400: Request processed in 39us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.285133:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788529728.285212:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279296 00000100:00100000:3.0:1788529728.285218:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279296 00000100:00100000:3.0:1788529728.285265:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1788529728.285274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158279296:12345-192.168.201.52@tcp:400: 00000100:00100000:3.0:1788529728.285308:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158279296:12345-192.168.201.52@tcp:400: Request processed in 36us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529728.285314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00080000:1.0:1788529728.288009:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529728.288023:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529728.288028:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788529728.616176:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff4ef18e0 20000000:00000080:3.0:1788529728.616205:0:8449:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabf5ed7400 uarg=0000000000000000 20000000:01000000:3.0:1788529728.616257:0:8449:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788529728.616260:0:8449:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788529728.616263:0:8449:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788529728.616269:0:8449:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788529728.616276:0:8449:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788529728.616298:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788529728.616301:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788529728.616684:0:8449:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788529728.616689:0:8449:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788529728.629021:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788529728.629881:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788529728.629966:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788529728.630016:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788529728.630033:0:8449:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788529728.630037:0:8449:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788529728.633400:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788529728.634171:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788529728.634250:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788529728.634286:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788529728.634303:0:8449:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788529728.634306:0:8449:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788529728.635354:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788529728.635755:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788529728.635826:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788529728.635878:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788529728.635937:0:8449:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788529728.635940:0:8449:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788529728.637335:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788529728.637865:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788529728.637960:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788529728.637991:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1788529728.638010:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788529728.638037:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638061:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638069:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638090:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638099:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aece expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638106:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638113:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638120:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638127:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638134:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638145:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638153:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638161:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638228:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638249:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 9 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638268:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568640:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529728.638415:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638424:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 9 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638432:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568768:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529728.638488:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638497:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638507:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568896:0@lo:104: 00000100:00100000:1.0:1788529728.638557:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.638593:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638601:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638619:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569024:0@lo:104: 00000100:00100000:1.0:1788529728.638638:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.638659:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638667:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638676:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569152:0@lo:104: 00000100:00100000:1.0:1788529728.638691:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.638702:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638710:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638717:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569280:0@lo:104: 00000100:00100000:1.0:1788529728.638731:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.638741:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638748:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 22 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638755:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569408:0@lo:104: 00000100:00100000:1.0:1788529728.638774:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.638789:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638806:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638815:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569536:0@lo:104: 00010000:00010000:1.0:1788529728.638838:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638846:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 22 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638854:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569664:0@lo:104: 00010000:00010000:1.0:1788529728.638872:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638879:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 22 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638887:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569792:0@lo:104: 00010000:00010000:1.0:1788529728.638932:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529728.638939:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 22 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.638947:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569920:0@lo:104: 00000100:00100000:1.0:1788529728.638963:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529728.639302:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788529728.639325:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.639336:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.639346:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.639365:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.639376:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185568896 00000100:00100000:2.0:1788529728.639386:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185568896 00000100:00100000:2.0:1788529728.639439:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569024 00000100:00100000:2.0:1788529728.639442:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569024 00000100:00100000:2.0:1788529728.639463:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569152 00000100:00100000:2.0:1788529728.639466:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569152 00000100:00100000:2.0:1788529728.639474:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569280 00000100:00100000:2.0:1788529728.639476:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569280 00000100:00100000:2.0:1788529728.639484:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569408 00000100:00100000:2.0:1788529728.639486:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569408 00000100:00100000:2.0:1788529728.639494:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569536 00000100:00100000:2.0:1788529728.639496:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569536 00000100:00100000:2.0:1788529728.639505:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569664 00000100:00100000:2.0:1788529728.639507:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569664 00000100:00100000:2.0:1788529728.639515:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569792 00000100:00100000:2.0:1788529728.639516:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569792 00000100:00100000:2.0:1788529728.639523:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185569920 00000100:00100000:2.0:1788529728.639525:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185569920 00000100:00100000:2.0:1788529728.639539:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529728.639548:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:8449:x1875409185568896:12345-0@lo:104: 00010000:00010000:2.0:1788529728.639563:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.639647:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788529728.639654:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+11:8449:x1875409185568896:12345-0@lo:104: Request processed in 107us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.639662:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529728.639964:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788529728.639971:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+10:8449:x1875409185569024:12345-0@lo:104: 00010000:00010000:2.0:1788529728.639981:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640019:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788529728.640024:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+10:8449:x1875409185569024:12345-0@lo:104: Request processed in 54us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640030:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788529728.640040:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788529728.640045:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+9:8449:x1875409185569152:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640052:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640076:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788529728.640081:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+9:8449:x1875409185569152:12345-0@lo:104: Request processed in 36us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640087:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788529728.640095:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788529728.640100:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+8:8449:x1875409185569280:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640107:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640135:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788529728.640140:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+8:8449:x1875409185569280:12345-0@lo:104: Request processed in 40us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640146:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788529728.640156:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788529728.640161:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc32a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+7:8449:x1875409185569408:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640168:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640187:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788529728.640191:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc32a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+7:8449:x1875409185569408:12345-0@lo:104: Request processed in 31us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640197:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788529728.640245:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529728.640250:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+6:8449:x1875409185569536:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640258:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640279:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788529728.640283:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+6:8449:x1875409185569536:12345-0@lo:104: Request processed in 34us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640289:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529728.640297:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788529728.640302:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:8449:x1875409185569664:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640308:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640333:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788529728.640337:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+5:8449:x1875409185569664:12345-0@lo:104: Request processed in 35us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640343:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788529728.640352:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788529728.640357:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:8449:x1875409185569792:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640364:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640382:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788529728.640387:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+4:8449:x1875409185569792:12345-0@lo:104: Request processed in 30us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640392:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788529728.640400:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788529728.640405:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8449:x1875409185569920:12345-0@lo:104: 00010000:00010000:2.0:1788529728.640412:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.640429:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788529728.640434:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8449:x1875409185569920:12345-0@lo:104: Request processed in 29us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.640439:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788529728.641578:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788529728.641592:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641627:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.641632:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641644:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.641652:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529728.641658:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529728.641738:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641746:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.641774:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641782:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7a00/0xaa46022e3f18af4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641801:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788529728.641805:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641811:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.641814:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641833:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.641840:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529728.641845:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529728.641862:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641868:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.641873:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641880:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030e00/0xaa46022e3f18af22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641890:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788529728.641907:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641913:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.641916:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641922:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.641929:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529728.641938:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529728.641953:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641957:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.641975:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641982:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18af06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18af0d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641990:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788529728.641994:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.641999:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.642001:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642007:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.642012:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529728.642016:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529728.642027:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642033:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.642045:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642051:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49400/0xaa46022e3f18aef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aeff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642060:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788529728.642063:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642069:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.642072:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642078:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.642083:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529728.642089:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788529728.642100:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642106:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.642110:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642116:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030c00/0xaa46022e3f18aeea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aef1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642122:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788529728.642125:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788529728.642129:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642135:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529728.642138:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642145:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529728.642152:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529728.642157:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788529728.642162:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570304:0@lo:103: 00010000:00010000:3.0:1788529728.642171:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642176:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529728.642180:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642195:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18aece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18aed5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642204:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529728.642207:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642213:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3600 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529728.642215:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642223:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788529728.642230:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529728.642236:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529728.642248:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642254:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529728.642258:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642264:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3600/0xaa46022e3f18ae5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae65 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642271:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529728.642280:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642280:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570816:0@lo:103: 00010000:00010000:3.0:1788529728.642286:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529728.642289:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642296:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788529728.642302:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529728.642307:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788529728.642315:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529728.642320:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570432:0@lo:103: 00010000:00010000:3.0:1788529728.642331:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642337:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788529728.642339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.642544:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570304 00000100:00100000:2.0:1788529728.642554:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570304 00010000:00010000:2.0:1788529728.642588:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 23 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642607:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570816 00000100:00100000:2.0:1788529728.642610:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570816 00010000:00010000:2.0:1788529728.642621:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 24 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570432 00000100:00100000:2.0:1788529728.642632:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570432 00010000:00010000:2.0:1788529728.642643:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 25 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.642655:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529728.642665:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3300:x1875409185570304:12345-0@lo:103: 00010000:00010000:3.0:1788529728.642669:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642675:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18ae50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae57 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642681:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.642687:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 25 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.642688:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529728.642689:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529728.642691:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529728.642698:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 25 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529728.642730:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788529728.642731:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529728.642736:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570944:0@lo:103: 00000100:00100000:2.0:1788529728.642763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3300:x1875409185570304:12345-0@lo:103: Request processed in 100us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529728.642765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.642772:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529728.642789:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570944 00000100:00100000:2.0:1788529728.642792:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570944 00010000:00010000:2.0:1788529728.642803:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 25 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529728.642814:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570304:0@lo:103: 00000100:00100000:2.0:1788529728.642814:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788529728.642818:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3300:x1875409185570816:12345-0@lo:103: 00010000:00010000:2.0:1788529728.642828:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.642832:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 25 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642840:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 25 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642850:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529728.642882:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3300:x1875409185570816:12345-0@lo:103: Request processed in 63us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.642889:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788529728.642924:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788529728.642930:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3300:x1875409185570432:12345-0@lo:103: 00010000:00010000:2.0:1788529728.642940:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.642944:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 24 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642963:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 24 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.642973:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529728.642995:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570816:0@lo:103: 00000100:00100000:2.0:1788529728.642996:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3300:x1875409185570432:12345-0@lo:103: Request processed in 67us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.643002:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788529728.643012:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570432:0@lo:103: 00000100:00100000:2.0:1788529728.643013:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788529728.643019:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185570944:12345-0@lo:103: 00010000:00010000:2.0:1788529728.643027:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.643031:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 23 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.643039:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 23 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.643049:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529728.643078:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185570944:12345-0@lo:103: Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.643084:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529728.643184:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568896:0@lo:104: 00000100:00100000:0.0:1788529728.643193:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570048:0@lo:103: 00000100:00100000:1.0:1788529728.643197:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569024:0@lo:104: 00010000:00010000:1.0:1788529728.643215:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3e00/0xaa46022e3f18af0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18af06 expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.643226:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569152:0@lo:104: 00000100:00100000:0.0:1788529728.643228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529728.643236:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18aeff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18aef8 expref: 21 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.643243:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569280:0@lo:104: 00000100:00100000:0.0:1788529728.643246:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570560:0@lo:103: 00000100:00100000:1.0:1788529728.643252:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569408:0@lo:104: 00000100:00100000:1.0:1788529728.643263:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569536:0@lo:104: 00000100:00100000:0.0:1788529728.643266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529728.643272:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569664:0@lo:104: 00000100:00100000:0.0:1788529728.643277:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788529728.643281:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570176:0@lo:103: 00010000:00010000:1.0:1788529728.643282:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3000/0xaa46022e3f18ae65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae5e expref: 20 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.643291:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569792:0@lo:104: 00010000:00010000:1.0:1788529728.643299:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18ae57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae50 expref: 19 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.643299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529728.643307:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185569920:0@lo:104: 00000100:00100000:0.0:1788529728.643307:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570688:0@lo:103: 00000100:00100000:0.0:1788529728.643338:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529728.643377:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570048 00000100:00100000:0.0:1788529728.643381:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570048 00010000:00010000:0.0:1788529728.643400:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 19 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.643413:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570560 00000100:00100000:0.0:1788529728.643416:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570560 00010000:00010000:0.0:1788529728.643427:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 20 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.643460:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570176 00000100:00100000:0.0:1788529728.643464:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570176 00010000:00010000:0.0:1788529728.643477:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 21 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.643487:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185570688 00000100:00100000:0.0:1788529728.643489:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185570688 00010000:00010000:0.0:1788529728.643500:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.643513:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788529728.643519:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5076c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:3302:x1875409185570048:12345-0@lo:103: 00010000:00010000:0.0:1788529728.643527:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529728.643531:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643539:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643549:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18af53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18af4c expref: 22 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643560:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529728.643596:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5076c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3302:x1875409185570048:12345-0@lo:103: Request processed in 78us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529728.643602:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788529728.643641:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788529728.643647:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3302:x1875409185570560:12345-0@lo:103: 00010000:00010000:0.0:1788529728.643663:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529728.643668:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 20 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643678:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 20 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643688:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030600/0xaa46022e3f18aef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18aeea expref: 20 pid: 5823 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643697:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529728.643719:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+19:3302:x1875409185570560:12345-0@lo:103: Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529728.643726:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788529728.643737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788529728.643744:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3302:x1875409185570176:12345-0@lo:103: 00010000:00010000:0.0:1788529728.643751:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529728.643756:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 18 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.643765:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 18 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.643778:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570048:0@lo:103: 00000100:00100000:1.0:1788529728.643786:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570560:0@lo:103: 00010000:00010000:0.0:1788529728.644083:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18af29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18af22 expref: 18 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.644093:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529728.644129:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:3302:x1875409185570176:12345-0@lo:103: Request processed in 385us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529728.644135:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788529728.644157:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529728.644164:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:3302:x1875409185570688:12345-0@lo:103: 00010000:00010000:0.0:1788529728.644172:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529728.644177:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 16 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.644185:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 16 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.644196:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2200/0xaa46022e3f18aed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18aece expref: 16 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.644204:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529728.644216:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570176:0@lo:103: 00000100:00100000:0.0:1788529728.644224:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3302:x1875409185570688:12345-0@lo:103: Request processed in 62us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529728.644225:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185570688:0@lo:103: 00000100:00100000:0.0:1788529728.644230:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788529728.644722:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185570944:0@lo:103: 00000100:00100000:1.0:1788529728.650347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529728.650421:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568640:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529728.650769:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529728.650786:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.650799:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529728.650804:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.650844:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529728.650853:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.650857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279808 10000000:01000000:2.0:1788529728.650859:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788529728.650869:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279808 00010000:00010000:0.0:1788529728.650932:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 10 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.650933:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.650941:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529728.650965:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.650969:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00010000:00010000:2.0:1788529728.650972:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18ae96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae9d expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.650979:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158279808:12345-192.168.201.52@tcp:103: 00010000:00010000:2.0:1788529728.650992:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529728.650994:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529728.650996:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529728.650997:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529728.651003:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 10 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.651009:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529728.651010:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529728.651015:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 10 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529728.651050:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529728.652587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529728.652658:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185571072:0@lo:103: 00000100:00100000:1.0:1788529728.652734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529728.652915:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788529728.652929:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788529728.655084:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279680 00000100:00100000:2.0:1788529728.655101:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279680 00010000:00010000:2.0:1788529728.655157:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 11 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.655201:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788529728.655223:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571072 00000100:00100000:2.0:1788529728.655226:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571072 00010000:00010000:2.0:1788529728.655241:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 15 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529728.655254:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788529728.655263:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1788529728.655272:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+11:2355:x1875409158279680:12345-192.168.201.52@tcp:103: 00010000:00010000:2.0:1788529728.655291:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.655298:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 11 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655318:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 11 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655341:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18af68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c66 expref: 11 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655365:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529728.655457:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158279680:12345-192.168.201.52@tcp:103: Request processed in 175us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.655465:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1788529728.655484:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788529728.655490:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788529728.655498:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:3302:x1875409185571072:12345-0@lo:103: 00010000:00010000:2.0:1788529728.655507:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529728.655511:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 15 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655533:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 15 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655545:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2a00/0xaa46022e3f18ae9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae96 expref: 15 pid: 5824 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655557:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655567:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655585:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655594:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655601:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655608:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655615:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529728.655620:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655631:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655651:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529728.655664:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529728.655727:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+14:3302:x1875409185571072:12345-0@lo:103: Request processed in 231us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529728.655734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788529728.655764:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61dfe00/0xaa46022e3f18af61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c5f expref: 9 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529728.656119:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185571072:0@lo:103: 00000100:00100000:3.0:1788529728.656950:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875409185568768:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529728.657010:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.657022:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.657028:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529728.657035:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afa0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529728.657588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bccf9d7-1f26-4f23-8349-edc335a13477+8:2355:x1875409158279808:12345-192.168.201.52@tcp:103: Request processed in 6606us (7252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529728.657600:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00010000:00010000:3.0:1788529728.849887:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529729.869628:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788529730.253619:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788529730.253631:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8caac4efb800 from 39 10000000:01000000:2.0:1788529730.253638:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529730.253706:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.253721:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.253734:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.253769:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571200:0@lo:101: 00000100:00100000:2.0:1788529730.253871:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.253997:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.254014:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571200 00000100:00100000:0.0:1788529730.254024:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571200 00000100:00100000:0.0:1788529730.254090:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788529730.254102:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+14:5827:x1875409185571200:12345-0@lo:101: 00010000:00010000:0.0:1788529730.254119:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529730.254138:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61df200/0xaa46022e3f18afae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afa7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.254168:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61df200/0xaa46022e3f18afae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afa7 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.254181:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61df200/0xaa46022e3f18afae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afa7 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.254192:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df200, rc 0) 00000100:00100000:0.0:1788529730.254253:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571200:12345-0@lo:101: Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.254260:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788529730.255123:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571200:0@lo:101: 00010000:00010000:2.0:1788529730.255143:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.255155:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529730.260370:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788529730.269127:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529730.269630:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788529730.269683:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:2.0:1788529730.269718:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:2.0:1788529730.269795:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:2.0:1788529730.269832:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:2.0:1788529730.269882:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:2.0:1788529730.272640:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:2.0:1788529730.272709:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:2.0:1788529730.272790:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:2.0:1788529730.272821:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:2.0:1788529730.272848:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:2.0:1788529730.274018:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:2.0:1788529730.274153:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:2.0:1788529730.274190:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:2.0:1788529730.274258:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:2.0:1788529730.274297:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:2.0:1788529730.274342:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:2.0:1788529730.274396:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:2.0:1788529730.274452:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:2.0:1788529730.274488:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:2.0:1788529730.274537:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:2.0:1788529730.274572:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:2.0:1788529730.274606:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:2.0:1788529730.274658:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:2.0:1788529730.274696:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:2.0:1788529730.274729:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:2.0:1788529730.274776:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:2.0:1788529730.274813:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:2.0:1788529730.274844:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:2.0:1788529730.281151:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13416 00000040:00080000:2.0:1788529730.281265:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13504 00000040:00080000:2.0:1788529730.281291:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13632 00000040:00080000:2.0:1788529730.285041:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13776 00000040:00080000:2.0:1788529730.285159:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13904 00000040:00080000:2.0:1788529730.285196:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14128 00000040:00080000:2.0:1788529730.285240:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14352 00000040:00080000:2.0:1788529730.285277:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14432 00000040:00080000:2.0:1788529730.285867:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14656 00000040:00080000:2.0:1788529730.285878:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788529730.286118:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571328:0@lo:501: 00000100:00100000:2.0:1788529730.286216:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.286356:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.292161:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571328 00000100:00100000:1.0:1788529730.292186:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571328 00000100:00100000:1.0:1788529730.292278:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788529730.292291:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571328:12345-0@lo:501: 00000100:00100000:1.0:1788529730.292770:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571328:12345-0@lo:501: Request processed in 481us (6553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.292779:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788529730.292969:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571328:0@lo:501: 00000100:00100000:2.0:1788529730.293042:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571456:0@lo:503: 00000100:00100000:2.0:1788529730.293102:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.293145:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.293310:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571456 00000100:00100000:0.0:1788529730.293316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571456 00000100:00100000:0.0:1788529730.293364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788529730.293372:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571456:12345-0@lo:503: 00000100:00100000:0.0:1788529730.293574:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571456:12345-0@lo:503: Request processed in 203us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.293589:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788529730.293780:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571456:0@lo:503: 00000040:00080000:2.0:1788529730.294521:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529730.294618:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571584:0@lo:502: 00000100:00100000:2.0:1788529730.294678:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.294715:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.294937:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571584 00000100:00100000:0.0:1788529730.294943:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571584 00000100:00100000:0.0:1788529730.294990:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788529730.295000:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571584:12345-0@lo:502: 00000100:00100000:0.0:1788529730.295231:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571584:12345-0@lo:502: Request processed in 231us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.295238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788529730.295682:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571584:0@lo:502: 00000040:00080000:3.0:1788529730.304978:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788529730.305122:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:3.0:1788529730.305161:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:3.0:1788529730.305215:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:3.0:1788529730.305254:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:3.0:1788529730.305320:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:3.0:1788529730.305359:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:3.0:1788529730.305407:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:3.0:1788529730.305478:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:3.0:1788529730.305516:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:3.0:1788529730.305547:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:3.0:1788529730.305586:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:3.0:1788529730.305615:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:3.0:1788529730.305644:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:3.0:1788529730.305691:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:3.0:1788529730.305723:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:3.0:1788529730.305750:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:3.0:1788529730.305790:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:3.0:1788529730.305818:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:3.0:1788529730.305845:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:3.0:1788529730.305884:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:3.0:1788529730.305948:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:3.0:1788529730.305977:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:3.0:1788529730.306019:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:3.0:1788529730.306055:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:3.0:1788529730.306083:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:3.0:1788529730.306124:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:3.0:1788529730.306153:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:3.0:1788529730.306180:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:3.0:1788529730.306220:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:3.0:1788529730.306248:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:3.0:1788529730.306274:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:3.0:1788529730.306301:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:3.0:1788529730.306340:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:3.0:1788529730.306369:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:3.0:1788529730.306407:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:3.0:1788529730.306449:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000040:00080000:3.0:1788529730.306477:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:3.0:1788529730.306540:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14880 00000040:00080000:3.0:1788529730.306573:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 120 off15000 00000100:00100000:3.0:1788529730.306653:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571712:0@lo:502: 00000100:00100000:3.0:1788529730.306759:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.306832:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.307095:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571712 00000100:00100000:1.0:1788529730.307104:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571712 00000100:00100000:1.0:1788529730.307169:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788529730.307180:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571712:12345-0@lo:502: 00000100:00100000:1.0:1788529730.307503:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571712:12345-0@lo:502: Request processed in 324us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.307513:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788529730.312119:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571712:0@lo:502: 00000040:00080000:3.0:1788529730.313283:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 224 off15224 00000040:00080000:3.0:1788529730.314406:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:3.0:1788529730.321594:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000020:01000000:2.0:1788529730.335641:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788529730.335677:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529730.335695:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.335743:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529730.341666:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788529730.341681:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788529730.341689:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788529730.341769:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529730.341786:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529730.341799:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529730.341833:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571840:0@lo:101: 00000100:00100000:3.0:1788529730.341961:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.342028:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.342123:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571840 00000100:00100000:1.0:1788529730.342135:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571840 00000100:00100000:1.0:1788529730.342221:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788529730.342235:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+15:5827:x1875409185571840:12345-0@lo:101: 00010000:00010000:1.0:1788529730.342251:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529730.342269:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18afbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afb5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.342299:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18afbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afb5 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.342341:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18afbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afb5 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.342351:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49200, rc 0) 00000100:00100000:1.0:1788529730.342412:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185571840:12345-0@lo:101: Request processed in 179us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.342428:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788529730.342568:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571840:0@lo:101: 00010000:00010000:0.0:1788529730.342586:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.342595:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529730.343200:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788529730.343631:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529730.343932:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788529730.343979:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:0.0:1788529730.344016:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:0.0:1788529730.344065:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:0.0:1788529730.344118:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:0.0:1788529730.344151:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:0.0:1788529730.344217:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:0.0:1788529730.344224:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788529730.344308:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571968:0@lo:501: 00000100:00100000:0.0:1788529730.344380:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529730.344437:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.344628:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185571968 00000100:00100000:1.0:1788529730.344637:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185571968 00000100:00100000:1.0:1788529730.344688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788529730.344699:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185571968:12345-0@lo:501: 00000100:00100000:1.0:1788529730.344998:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185571968:12345-0@lo:501: Request processed in 301us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.345007:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788529730.345173:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185571968:0@lo:501: 00000100:00100000:3.0:1788529730.345217:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572096:0@lo:503: 00000100:00100000:3.0:1788529730.345260:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.345286:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.345335:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572096 00000100:00100000:1.0:1788529730.345339:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572096 00000100:00100000:1.0:1788529730.345361:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788529730.345367:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572096:12345-0@lo:503: 00000100:00100000:1.0:1788529730.345530:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572096:12345-0@lo:503: Request processed in 162us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.345536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788529730.345600:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572096:0@lo:503: 00000040:00080000:3.0:1788529730.346262:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529730.346376:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572224:0@lo:502: 00000100:00100000:3.0:1788529730.346441:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.346472:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.346616:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572224 00000100:00100000:1.0:1788529730.346622:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572224 00000100:00100000:1.0:1788529730.346651:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788529730.346659:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572224:12345-0@lo:502: 00000100:00100000:1.0:1788529730.346857:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572224:12345-0@lo:502: Request processed in 198us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.346869:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788529730.348491:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572224:0@lo:502: 00000040:00080000:3.0:1788529730.348830:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788529730.350775:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:3.0:1788529730.350887:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788529730.364859:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788529730.366125:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788529730.366172:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788529730.366236:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:1.0:1788529730.366273:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788529730.366532:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:1.0:1788529730.366604:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572352:0@lo:502: 00000100:00100000:1.0:1788529730.366742:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.368589:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.372116:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572352 00000100:00100000:3.0:1788529730.372138:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572352 00000100:00100000:3.0:1788529730.372223:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788529730.372235:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572352:12345-0@lo:502: 00000100:00100000:3.0:1788529730.374215:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572352:12345-0@lo:502: Request processed in 1968us (7461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529730.374229:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788529730.374444:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572352:0@lo:502: 00000040:00080000:1.0:1788529730.375868:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:1.0:1788529730.376039:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788529730.381515:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529730.381531:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529730.381534:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788529730.381540:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788529730.381556:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529730.381559:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529730.381560:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788529730.381564:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788529730.382089:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788529730.382109:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788529730.382125:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.382139:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529730.382151:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788529730.382154:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8caac4efb800 from 1 10000000:01000000:1.0:1788529730.382158:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788529730.382210:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.382219:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.382254:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529730.382288:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.382376:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.382433:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77600 going to sleep for 11 seconds 00000100:00100000:2.0:1788529730.382696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572480 00000100:00100000:2.0:1788529730.382706:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572480 00000100:00100000:2.0:1788529730.382771:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788529730.382784:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+16:5827:x1875409185572480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.382801:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529730.382818:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18afca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afc3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.382847:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18afca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afc3 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.382859:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18afca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afc3 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.382868:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2400, rc 0) 00000100:00100000:2.0:1788529730.383051:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.383059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788529730.383160:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529730.383177:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.383187:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529730.383286:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.383316:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529730.386341:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.396142:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572608 00000100:00100000:3.0:1788529730.396170:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572608 00000100:00100000:3.0:1788529730.396424:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788529730.396442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.396987:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (13667us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529730.396997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788529730.397325:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788529730.397361:0:5827:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788529730.397483:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.397528:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.397578:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.399023:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572736 00000100:00100000:3.0:1788529730.399035:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572736 00000100:00100000:3.0:1788529730.399089:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788529730.399099:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.400102:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1000us (2569us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529730.400128:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788529730.404709:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572736:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788529730.404850:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788529730.404864:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.404876:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529730.404889:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788529730.406128:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabf402e800 from 39 10000000:01000000:2.0:1788529730.406134:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529730.406194:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.406204:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.406217:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.406248:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.406336:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.406441:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.412627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572864 00000100:00100000:1.0:1788529730.412649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572864 00000100:00100000:1.0:1788529730.412736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788529730.412749:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:5827:x1875409185572864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529730.412772:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529730.412798:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afd1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.412836:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afd1 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.412849:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afd1 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.412859:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49e00, rc 0) 00000100:00100000:1.0:1788529730.413282:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185572864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 535us (6945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.413291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788529730.413402:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.413437:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.413447:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529730.415747:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000040:00080000:2.0:1788529730.427291:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529730.428441:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788529730.429090:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788529730.429131:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788529730.429188:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788529730.429230:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788529730.429282:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788529730.429312:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788529730.429360:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788529730.429400:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788529730.431695:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788529730.431763:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788529730.431853:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788529730.432999:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788529730.433090:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788529730.433163:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788529730.433200:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788529730.433232:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788529730.433286:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788529730.433322:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788529730.433356:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788529730.433406:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788529730.434594:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788529730.434660:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788529730.434750:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788529730.434789:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788529730.434823:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788529730.434872:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788529730.441083:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788529730.441205:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788529730.441311:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788529730.441340:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788529730.441366:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788529730.441395:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788529730.444679:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788529730.444778:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788529730.444821:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788529730.444851:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788529730.444996:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788529730.445006:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 38 count 39 00000100:00100000:3.0:1788529730.445164:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.445250:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.445312:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.445564:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185572992 00000100:00100000:0.0:1788529730.445576:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185572992 00000100:00100000:0.0:1788529730.445640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788529730.445651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185572992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.446003:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185572992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.446013:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788529730.446230:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185572992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.446285:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.446352:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.446383:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529730.446653:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573120 00000100:00100000:2.0:1788529730.446659:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573120 00000100:00100000:2.0:1788529730.446699:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788529730.446707:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.447029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.447037:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788529730.447102:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788529730.450755:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788529730.450982:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573248:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.452734:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.452796:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.453213:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573248 00000100:00100000:1.0:1788529730.453226:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573248 00000100:00100000:1.0:1788529730.453296:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788529730.453309:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573248:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.453717:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573248:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 409us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.453727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788529730.454172:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573248:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788529730.454527:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788529730.454590:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788529730.454618:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788529730.454660:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788529730.454692:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788529730.454741:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788529730.454773:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788529730.454800:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788529730.454840:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788529730.454875:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788529730.454945:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788529730.455005:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788529730.455304:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788529730.455343:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788529730.455388:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788529730.455436:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788529730.455761:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788529730.455813:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788529730.455848:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788529730.455885:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788529730.457360:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788529730.457408:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788529730.457472:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788529730.457524:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788529730.457563:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788529730.457600:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788529730.457677:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788529730.457730:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788529730.457762:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788529730.457821:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788529730.457858:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788529730.457924:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788529730.457965:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788529730.458013:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788529730.458884:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788529730.459176:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788529730.459212:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788529730.459243:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788529730.459288:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788529730.459319:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788529730.459382:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573376:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.460143:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.460740:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573376 00000100:00100000:2.0:1788529730.460752:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573376 00000100:00100000:2.0:1788529730.461112:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788529730.461127:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573376:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.463085:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573376:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 1949us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.463104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788529730.463245:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.463281:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573376:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788529730.463473:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788529730.463499:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:3.0:1788529730.465507:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788529730.465773:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788529730.465792:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788529730.465807:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.465821:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529730.465839:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788529730.465842:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788529730.465846:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788529730.465931:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.465941:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.465956:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529730.465987:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.466091:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529730.467990:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.469493:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573504 00000100:00100000:1.0:1788529730.469513:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573504 00000100:00100000:0.0:1788529730.469978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788529730.469993:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+18:5827:x1875409185573504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529730.470018:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529730.470054:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61de800/0xaa46022e3f18afe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afdf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.470095:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61de800/0xaa46022e3f18afe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afdf expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.470136:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61de800/0xaa46022e3f18afe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afdf expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.470147:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de800, rc 0) 00000100:00100000:0.0:1788529730.470254:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.470261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788529730.470721:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.470747:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.470758:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529730.471279:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788529730.471686:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529730.472290:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788529730.472356:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788529730.472386:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788529730.472566:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788529730.472604:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788529730.472632:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788529730.472671:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788529730.472700:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788529730.472727:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788529730.472792:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788529730.472800:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:2.0:1788529730.473167:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.473256:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.473316:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.473478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573632 00000100:00100000:1.0:1788529730.473486:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573632 00000100:00100000:1.0:1788529730.473549:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788529730.473561:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.473861:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.473870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788529730.474251:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.474309:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.474357:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.474388:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.474534:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573760 00000100:00100000:3.0:1788529730.474540:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573760 00000100:00100000:3.0:1788529730.474573:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788529730.474581:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.474764:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529730.474771:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788529730.475012:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529730.475811:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529730.478689:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573888:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.478966:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.479232:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185573888 00000100:00100000:1.0:1788529730.479246:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185573888 00000100:00100000:1.0:1788529730.479327:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788529730.479339:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573888:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.479721:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185573888:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 383us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.479732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788529730.480211:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.480247:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185573888:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788529730.480669:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788529730.480736:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788529730.480770:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788529730.480812:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788529730.480841:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788529730.480867:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788529730.481601:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788529730.481664:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788529730.481699:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788529730.481785:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788529730.481827:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788529730.481876:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788529730.489671:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574016:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.489834:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.489989:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574016 00000100:00100000:1.0:1788529730.490000:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574016 00000100:00100000:1.0:1788529730.490297:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788529730.490310:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185574016:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.491316:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.499788:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185574016:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 9465us (9939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529730.499808:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788529730.500072:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574016:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788529730.500273:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788529730.500308:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788529730.503809:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529730.503826:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529730.503829:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788529730.503836:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788529730.503858:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529730.503861:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529730.503863:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788529730.503867:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788529730.504805:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788529730.504828:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788529730.504844:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.504859:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529730.504888:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788529730.504921:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabf402e800 from 1 10000000:01000000:2.0:1788529730.504925:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788529730.504971:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.504980:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.504992:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.505023:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.505180:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.505236:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.506274:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574144 00000100:00100000:0.0:1788529730.506288:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574144 00000100:00100000:0.0:1788529730.506364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788529730.506376:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+19:5827:x1875409185574144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529730.506395:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529730.506426:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61dec00/0xaa46022e3f18aff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18afed expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.506477:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61dec00/0xaa46022e3f18aff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18afed expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.506492:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61dec00/0xaa46022e3f18aff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18afed expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.506503:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dec00, rc 0) 00000100:00100000:0.0:1788529730.506575:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.506582:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788529730.506742:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.506764:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.506776:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.506981:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.507012:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.507167:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.507253:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574272 00000100:00100000:3.0:1788529730.507259:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574272 00000100:00100000:3.0:1788529730.507295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788529730.507302:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.507715:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (701us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529730.507724:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788529730.508597:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574272:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788529730.508626:0:5827:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788529730.508740:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.508781:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.508826:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.511964:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574400 00000100:00100000:3.0:1788529730.511986:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574400 00000100:00100000:3.0:1788529730.512085:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788529730.512098:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.512546:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (3763us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529730.512555:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788529730.514430:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788529730.514556:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788529730.514573:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.514587:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529730.514602:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788529730.514607:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabc80f0000 from 39 10000000:01000000:2.0:1788529730.514610:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529730.514665:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.514675:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.514689:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.514725:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.514803:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.514869:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.515069:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574528 00000100:00100000:0.0:1788529730.515081:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574528 00000100:00100000:0.0:1788529730.515162:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788529730.515176:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185574528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529730.515217:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529730.515238:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61dea00/0xaa46022e3f18b002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18affb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.515270:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61dea00/0xaa46022e3f18b002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18affb expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.515282:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61dea00/0xaa46022e3f18b002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18affb expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.515292:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dea00, rc 0) 00000100:00100000:0.0:1788529730.515339:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185574528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.515346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788529730.515691:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.515706:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.515724:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.515763:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.515787:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.515816:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.516567:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574656 00000100:00100000:0.0:1788529730.516574:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574656 00000100:00100000:0.0:1788529730.516617:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788529730.516624:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185574656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.517002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185574656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.517011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788529730.522218:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.522306:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.522424:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.523018:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574784 00000100:00100000:1.0:1788529730.523037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574784 00000100:00100000:1.0:1788529730.523155:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788529730.523165:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185574784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.523404:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185574784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.523424:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788529730.523663:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.523681:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185574784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.528212:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8472:1875409185574912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529730.528348:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.532155:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529730.535188:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185574912 00000100:00100000:2.0:1788529730.535206:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185574912 00000100:00100000:2.0:1788529730.535294:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788529730.535305:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:8472:x1875409185574912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529730.535817:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:8472:x1875409185574912:12345-0@lo:502:llog_process_th.0 Request processed in 510us (7467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.535827:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788529730.538122:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8472:1875409185574912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529730.538235:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8472:1875409185575040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529730.538325:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529730.538376:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529730.538629:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575040 00000100:00100000:2.0:1788529730.538639:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575040 00000100:00100000:2.0:1788529730.538694:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788529730.538705:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:8472:x1875409185575040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529730.539221:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:8472:x1875409185575040:12345-0@lo:502:llog_process_th.0 Request processed in 516us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.539230:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788529730.539349:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8472:1875409185575040:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788529730.539379:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788529730.540132:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788529730.540144:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529730.540158:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.540170:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529730.540194:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788529730.540197:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788529730.540201:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788529730.540242:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.540251:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.540262:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.540284:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.540328:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.541062:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.546643:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575168 00000100:00100000:1.0:1788529730.546666:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575168 00000100:00100000:1.0:1788529730.546751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788529730.546765:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185575168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529730.546788:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529730.546813:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49000/0xaa46022e3f18b010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b009 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.546854:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49000/0xaa46022e3f18b010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b009 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.546869:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49000/0xaa46022e3f18b010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b009 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529730.546881:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49000, rc 0) 00000100:00100000:1.0:1788529730.547018:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (6688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.547059:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788529730.547301:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.547326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.547337:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529730.547407:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.547472:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.547526:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788529730.547639:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575296 00000100:00100000:1.0:1788529730.547644:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575296 00000100:00100000:1.0:1788529730.547668:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788529730.547674:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.548240:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 565us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529730.548248:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788529730.548317:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.548352:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529730.548398:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529730.548428:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.548636:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575424 00000100:00100000:0.0:1788529730.548641:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575424 00000100:00100000:0.0:1788529730.548693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788529730.548700:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.548857:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.548872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788529730.549143:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529730.549583:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8473:1875409185575552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788529730.549626:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.549663:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.549731:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575552 00000100:00100000:3.0:1788529730.549737:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575552 00000100:00100000:3.0:1788529730.549778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788529730.549787:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:8473:x1875409185575552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529730.550297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:8473:x1875409185575552:12345-0@lo:502:llog_process_th.0 Request processed in 510us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529730.550306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788529730.550383:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8473:1875409185575552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788529730.550420:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529730.550431:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529730.550434:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788529730.550441:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788529730.550523:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8473:1875409185575680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788529730.550556:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529730.550583:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788529730.550643:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575680 00000100:00100000:0.0:1788529730.550648:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575680 00000100:00100000:0.0:1788529730.550681:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788529730.550688:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:8473:x1875409185575680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529730.550844:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:8473:x1875409185575680:12345-0@lo:502:llog_process_th.0 Request processed in 156us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529730.550851:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788529730.550993:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8473:1875409185575680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788529730.551013:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529730.551019:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529730.551020:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788529730.551025:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788529730.551423:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788529730.551434:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788529730.551516:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.551530:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529730.551542:0:5827:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788529730.551545:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabc80f0000 from 1 10000000:01000000:0.0:1788529730.551549:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788529730.551586:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.551595:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.551605:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529730.551621:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.551668:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529730.551704:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529730.551755:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575808 00000100:00100000:2.0:1788529730.551762:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575808 00000100:00100000:2.0:1788529730.551802:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788529730.551810:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185575808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529730.551822:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529730.551837:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18b01e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b017 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.551866:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18b01e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b017 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.551879:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18b01e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b017 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.551890:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2000, rc 0) 00000100:00100000:2.0:1788529730.552022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185575808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529730.552107:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788529730.552211:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529730.552227:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.552238:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529730.552277:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529730.552302:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529730.552320:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529730.552394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185575936 00000100:00100000:3.0:1788529730.552399:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185575936 00000100:00100000:3.0:1788529730.552444:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788529730.552525:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185575936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529730.552834:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185575936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529730.552846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788529730.553129:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185575936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788529730.553146:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788529730.553155:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529730.553164:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529730.896663:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529731.150110:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185576320:0@lo:400:kworker.0 00000100:00100000:0.0:1788529731.150205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529731.150290:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788529731.150296:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185576192:0@lo:400:kworker.0 00000100:00100000:0.0:1788529731.150317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529731.150331:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185576704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529731.150373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529731.150538:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185576064:0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.150587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529731.150618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185576576:0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.150641:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529731.150669:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529731.150675:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185576448:0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.150702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529731.150748:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576320 00000100:00100000:3.0:1788529731.150757:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576320 00000100:00100000:3.0:1788529731.150843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576192 00000100:00100000:3.0:1788529731.150846:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576192 00000100:00100000:3.0:1788529731.150863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576576 00000100:00100000:3.0:1788529731.150866:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576576 00000100:00100000:3.0:1788529731.150886:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529731.150925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185576320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.150983:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185576320:12345-0@lo:400:kworker.0 Request processed in 61us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529731.150991:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529731.151012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529731.151030:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.151060:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185576192:12345-0@lo:400:kworker.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529731.151066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529731.151079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529731.151085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185576576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.151122:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185576576:12345-0@lo:400:kworker.0 Request processed in 37us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529731.151128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529731.151151:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576704 00000100:00100000:3.0:1788529731.151154:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576704 00000100:00100000:3.0:1788529731.151179:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788529731.151185:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185576704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529731.151217:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529731.151245:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185576704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529731.151252:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788529731.151272:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576448 00000100:00100000:3.0:1788529731.151275:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576448 00000100:00100000:3.0:1788529731.151299:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788529731.151305:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185576448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.151331:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185576448:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529731.151336:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788529731.151350:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529731.151353:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529731.151356:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788529731.151395:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5180 x1875409185576448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529731.151423:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185576448:0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.151435:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185576576:0@lo:400:kworker.0 00000100:00100000:3.0:1788529731.151466:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185576192:0@lo:400:kworker.0 00010000:00080000:3.0:1788529731.151484:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc720000 x1875409185576704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529731.151498:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185576704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529731.151508:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185576320:0@lo:400:kworker.0 00000100:00100000:0.0:1788529731.151975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576064 00000100:00100000:0.0:1788529731.151982:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576064 00000100:00100000:0.0:1788529731.152029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788529731.152037:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185576064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529731.152091:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185576064:12345-0@lo:400:kworker.0 Request processed in 54us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529731.152098:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788529731.152336:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529731.152350:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185576832:0@lo:400:kworker.0 00000100:00100000:1.0:1788529731.152394:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529731.154592:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185576064:0@lo:400:kworker.0 00000100:00100000:2.0:1788529731.154933:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576832 00000100:00100000:2.0:1788529731.154943:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576832 00000100:00100000:2.0:1788529731.155023:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529731.155034:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185576832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529731.155150:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185576832:12345-0@lo:400:kworker.0 Request processed in 118us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529731.155173:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788529731.155396:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e7480 x1875409185576832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529731.155421:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185576832:0@lo:400:kworker.0 00010000:00010000:3.0:1788529731.918052:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529732.941435:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529733.199596:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185576960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529733.199716:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529733.201423:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185576960 00000100:00100000:3.0:1788529733.201442:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185576960 00000100:00100000:3.0:1788529733.201561:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788529733.201574:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185576960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529733.201635:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529733.201746:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185576960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529733.201754:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788529733.201819:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c0000 x1875409185576960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529733.201843:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185576960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788529733.202178:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529733.402116:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529733.402290:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529733.402345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529733.402398:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529733.402440:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280320 00000100:00100000:2.0:1788529733.402454:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280320 00000100:00100000:2.0:1788529733.402531:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280192 00000100:00100000:2.0:1788529733.402534:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280192 00000100:00100000:0.0:1788529733.402659:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1788529733.402676:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158280320:12345-192.168.201.52@tcp:400: 00000100:00100000:0.0:1788529733.402781:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158280320:12345-192.168.201.52@tcp:400: Request processed in 110us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529733.402789:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1788529733.402803:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158279936 00000100:00100000:1.0:1788529733.402808:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158279936 00000100:00100000:1.0:1788529733.402844:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:1.0:1788529733.402851:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+8:2355:x1875409158279936:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1788529733.402884:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+8:2355:x1875409158279936:12345-192.168.201.52@tcp:400: Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529733.402891:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00080000:1.0:1788529733.402958:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529733.402964:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529733.403768:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1788529733.403787:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158280192:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1788529733.404032:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158280192:12345-192.168.201.52@tcp:400: Request processed in 252us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529733.404041:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1788529733.404568:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280064 00000100:00100000:3.0:1788529733.404580:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280064 00000100:00100000:3.0:1788529733.404659:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:3.0:1788529733.404668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158280064:12345-192.168.201.52@tcp:400: 00000100:00100000:3.0:1788529733.404726:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158280064:12345-192.168.201.52@tcp:400: Request processed in 60us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529733.404734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00080000:2.0:1788529733.405099:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788529733.965188:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529734.424135:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529734.424564:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280448 00000100:00100000:1.0:1788529734.424579:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280448 00000100:00100000:1.0:1788529734.424676:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1788529734.424690:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+8:5600:x1875409158280448:12345-192.168.201.52@tcp:101: 00010000:00010000:1.0:1788529734.424720:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529734.424753:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48a00/0xaa46022e3f18b025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0cc8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529734.424803:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48a00/0xaa46022e3f18b025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529734.424820:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48a00/0xaa46022e3f18b025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529734.424871:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48a00, rc 0) 00000100:00100000:1.0:1788529734.425130:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158280448:12345-192.168.201.52@tcp:101: Request processed in 442us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529734.425138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:2.0:1788529734.429187:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529734.430703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280576 00000100:00100000:0.0:1788529734.430720:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280576 00000100:00100000:0.0:1788529734.430796:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1788529734.430809:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158280576:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1788529734.431388:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158280576:12345-192.168.201.52@tcp:501: Request processed in 579us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529734.431398:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1788529734.434212:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529734.434313:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280704 00000100:00100000:3.0:1788529734.434329:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280704 00000100:00100000:3.0:1788529734.434409:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:3.0:1788529734.434421:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158280704:12345-192.168.201.52@tcp:503: 00000100:00100000:3.0:1788529734.434764:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158280704:12345-192.168.201.52@tcp:503: Request processed in 343us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529734.434774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:3.0:1788529734.449483:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529734.449773:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280832 00000100:00100000:1.0:1788529734.449788:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280832 00000100:00100000:1.0:1788529734.449857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:1.0:1788529734.449881:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+9:6099:x1875409158280832:12345-192.168.201.52@tcp:502: 00000100:00100000:1.0:1788529734.450367:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+9:6099:x1875409158280832:12345-192.168.201.52@tcp:502: Request processed in 488us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529734.450378:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:2.0:1788529734.452887:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529734.453163:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158280960 00000100:00100000:0.0:1788529734.453180:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158280960 00000100:00100000:0.0:1788529734.453265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:0.0:1788529734.453277:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+9:6099:x1875409158280960:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788529734.453701:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+9:6099:x1875409158280960:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 424us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529734.453711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:0.0:1788529734.463681:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529734.463964:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281088 00000100:00100000:3.0:1788529734.463981:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281088 00000100:00100000:3.0:1788529734.464066:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:3.0:1788529734.464082:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158281088:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529734.464110:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529734.464138:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7000/0xaa46022e3f18b02c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ccf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529734.464183:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7000/0xaa46022e3f18b02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ccf expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529734.464198:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd7000/0xaa46022e3f18b02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ccf expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529734.464209:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7000, rc 0) 00000100:00100000:3.0:1788529734.464288:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281088:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 210us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529734.464296:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:3.0:1788529734.469870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529734.470316:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281216 00000100:00100000:1.0:1788529734.470330:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281216 00000100:00100000:1.0:1788529734.470414:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:1.0:1788529734.470426:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281216:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529734.470846:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281216:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 421us (1003us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529734.473695:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00010000:00010000:3.0:1788529734.989309:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529736.022715:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529736.270242:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185577472:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270332:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270407:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788529736.270414:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185577088:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270444:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270468:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185577600:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270531:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185577216:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270570:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185577728:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270591:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270609:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529736.270614:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185577344:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529736.270663:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577088 00000100:00100000:1.0:1788529736.270670:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577088 00000100:00100000:1.0:1788529736.270715:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788529736.270723:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185577088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270770:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185577088:12345-0@lo:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.270778:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788529736.270806:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577600 00000100:00100000:1.0:1788529736.270810:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577600 00000100:00100000:1.0:1788529736.270842:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577216 00000100:00100000:1.0:1788529736.270846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577216 00000100:00100000:1.0:1788529736.270857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577344 00000100:00100000:1.0:1788529736.270859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577344 00000100:00100000:1.0:1788529736.270873:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529736.270879:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185577600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.270945:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185577600:12345-0@lo:400:kworker.0 Request processed in 65us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.270952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529736.270965:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788529736.270978:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185577216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271012:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185577216:12345-0@lo:400:kworker.0 Request processed in 34us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.271018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788529736.271031:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788529736.271037:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271062:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185577344:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.271068:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788529736.271090:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577472 00000100:00100000:1.0:1788529736.271093:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577472 00000100:00100000:1.0:1788529736.271117:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577728 00000100:00100000:1.0:1788529736.271120:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577728 00000100:00100000:1.0:1788529736.271134:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529736.271141:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185577472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271170:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185577472:12345-0@lo:400:kworker.0 Request processed in 30us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.271176:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788529736.271186:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788529736.271192:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185577728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271215:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185577728:12345-0@lo:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529736.271221:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788529736.271242:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529736.271246:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529736.271248:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529736.271282:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185577344:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271304:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185577216:0@lo:400:kworker.0 00010000:00080000:1.0:1788529736.271328:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5880 x1875409185577728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529736.271340:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185577728:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271369:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185577088:0@lo:400:kworker.0 00000100:00100000:1.0:1788529736.271378:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185577600:0@lo:400:kworker.0 00010000:00080000:1.0:1788529736.271388:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e6680 x1875409185577472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529736.271397:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185577472:0@lo:400:kworker.0 00000100:00100000:3.0:1788529736.285208:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185577856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529736.285295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529736.285375:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185577856 00000100:00100000:3.0:1788529736.285385:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185577856 00000100:00100000:3.0:1788529736.285439:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788529736.285448:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185577856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529736.285487:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529736.285530:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185577856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529736.285537:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788529736.285583:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5c00 x1875409185577856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529736.285602:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185577856:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788529736.603380:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc16b15cd0 20000000:00000080:3.0:1788529736.603408:0:8515:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabf611d000 uarg=0000000000000000 20000000:01000000:3.0:1788529736.603464:0:8515:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788529736.603472:0:8515:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788529736.603479:0:8515:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788529736.606486:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788529736.606672:0:8515:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788529736.616082:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788529736.616223:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788529736.616337:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788529736.616367:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788529736.616399:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616453:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616464:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616472:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616485:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616496:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616568:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616600:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 9 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.616622:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185577984:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529736.616825:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.616835:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 22 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.616847:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578112:0@lo:104: 00000100:00100000:2.0:1788529736.618117:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788529736.618228:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.618244:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 22 pid: 5824 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.618259:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578240:0@lo:104: 00000100:00100000:2.0:1788529736.618300:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788529736.625724:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.625753:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 22 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.625772:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578368:0@lo:104: 00000100:00100000:2.0:1788529736.625860:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529736.626242:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529736.630000:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578112 00000100:00100000:0.0:1788529736.631539:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578112 00000100:00100000:0.0:1788529736.631631:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578240 00000100:00100000:0.0:1788529736.631635:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578240 00000100:00100000:0.0:1788529736.631656:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788529736.631669:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:8515:x1875409185578112:12345-0@lo:104: 00010000:00010000:0.0:1788529736.631695:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.631976:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529736.631984:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:8515:x1875409185578112:12345-0@lo:104: Request processed in 318us (13873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529736.631992:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788529736.632017:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529736.632023:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8515:x1875409185578240:12345-0@lo:104: 00010000:00010000:0.0:1788529736.632033:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632141:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529736.632149:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632157:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529736.632162:0:8454:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632191:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529736.632200:0:8454:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529736.632207:0:8454:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529736.632258:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632266:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529736.632292:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632301:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030200/0xaa46022e3f18ae88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ae8f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632337:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529736.632341:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632348:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529736.632351:0:8454:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632359:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529736.632366:0:8454:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529736.632378:0:8454:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529736.632393:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632400:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529736.632406:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632413:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48000/0xaa46022e3f18ada1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ada8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632422:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529736.632424:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529736.632426:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529736.632457:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185578624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529736.632507:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529736.632557:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529736.632563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185578496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529736.632583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529736.632609:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281344 00000100:00100000:3.0:1788529736.632615:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281344 00010000:00010000:3.0:1788529736.632645:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 10 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529736.632669:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578624 00000100:00100000:3.0:1788529736.632672:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578624 00010000:00010000:3.0:1788529736.632687:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 23 pid: 5824 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529736.632710:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578496 00000100:00100000:3.0:1788529736.632713:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578496 00010000:00010000:3.0:1788529736.632725:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 24 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529736.632737:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1788529736.632744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5077450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158281344:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529736.632759:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529736.632765:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 10 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632783:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 10 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632805:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529736.632866:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5077450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2355:x1875409158281344:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 122us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529736.632873:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1788529736.632945:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529736.632951:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3303:x1875409185578624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529736.632960:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529736.632964:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 24 pid: 5824 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632974:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 24 pid: 5824 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.632995:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529736.633022:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3303:x1875409185578624:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529736.633030:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529736.633042:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529736.633047:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185578496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529736.633055:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529736.633059:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 23 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.633069:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 23 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.633078:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529736.633097:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185578496:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529736.633103:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529736.633274:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185578496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529736.633284:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185578624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788529736.633406:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f540 going to sleep for 11 seconds 00010000:00010000:2.0:1788529736.633427:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18af76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c97 expref: 9 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.633438:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185577984:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529736.633450:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6e00/0xaa46022e3f18ae8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ae88 expref: 22 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.633460:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578112:0@lo:104: 00010000:00010000:2.0:1788529736.633468:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18ada8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ada1 expref: 21 pid: 5824 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.633477:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578240:0@lo:104: 00010000:00010000:0.0:1788529736.637616:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788529736.637643:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8515:x1875409185578240:12345-0@lo:104: Request processed in 5612us (19333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529736.637688:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529736.637763:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788529736.637793:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578368 00000100:00100000:0.0:1788529736.637805:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578368 00000100:00100000:0.0:1788529736.637846:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788529736.637855:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8515:x1875409185578368:12345-0@lo:104: 00010000:00010000:0.0:1788529736.637879:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638047:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529736.638053:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:8515:x1875409185578368:12345-0@lo:104: Request processed in 199us (12193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529736.638060:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788529736.638156:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529736.638163:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638172:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc13c9400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529736.638177:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638188:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529736.638196:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529736.638202:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788529736.638253:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638267:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788529736.638319:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638327:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc13c9400/0xaa46022e3f18ad31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18ad38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638354:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529736.638356:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529736.638358:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529736.638370:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788529736.638394:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185578752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529736.638449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529736.638494:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578752 00000100:00100000:0.0:1788529736.638499:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578752 00010000:00010000:0.0:1788529736.638522:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 21 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529736.638547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529736.638554:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3301:x1875409185578752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529736.638566:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529736.638573:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 21 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638592:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 21 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638616:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638634:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638654:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638663:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638672:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638680:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638686:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e2600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529736.638693:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638703:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638713:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529736.638726:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529736.638753:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3301:x1875409185578752:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529736.638761:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529736.638802:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185578752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788529736.638966:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7c00/0xaa46022e3f18ad38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18ad31 expref: 20 pid: 5823 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529736.638981:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875409185578368:0@lo:104: 00010000:00010000:2.0:1788529736.639009:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.639019:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.639027:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529736.639034:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b033 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529736.641100:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529737.037339:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529738.064623:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529738.268691:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529738.268945:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281472 00000100:00100000:0.0:1788529738.268961:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281472 00000100:00100000:0.0:1788529738.269039:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:0.0:1788529738.269055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+9:5600:x1875409158281472:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529738.269080:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529738.269108:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0cd6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.269151:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.269169:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.269183:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de000, rc 0) 00000100:00100000:0.0:1788529738.269266:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281472:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 214us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529738.269275:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:0.0:1788529738.271438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529738.279256:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281600 00000100:00100000:3.0:1788529738.279291:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281600 00000100:00100000:3.0:1788529738.279628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:3.0:1788529738.279653:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281600:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.280878:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281600:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 1224us (9446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.280923:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:3.0:1788529738.293221:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529738.293294:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281728 00000100:00100000:1.0:1788529738.293311:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281728 00000100:00100000:1.0:1788529738.293397:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:1.0:1788529738.293411:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281728:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529738.293714:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:5600:x1875409158281728:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 305us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529738.293724:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:3.0:1788529738.313188:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529738.313262:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281856 00000100:00100000:1.0:1788529738.313289:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281856 00000100:00100000:1.0:1788529738.313383:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:1.0:1788529738.313532:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:6156:x1875409158281856:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788529738.313983:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:6156:x1875409158281856:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 588us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529738.314002:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:1.0:1788529738.319728:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185578880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529738.326841:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529738.326977:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185578880 00000100:00100000:1.0:1788529738.326991:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185578880 00000100:00100000:1.0:1788529738.327065:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788529738.327079:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185578880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529738.327154:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529738.327221:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185578880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529738.327229:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788529738.327253:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529738.327311:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c0700 x1875409185578880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529738.327345:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185578880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529738.334533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529738.335215:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158281984 00000100:00100000:3.0:1788529738.335233:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158281984 00000100:00100000:3.0:1788529738.335323:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:3.0:1788529738.335338:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:6156:x1875409158281984:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788529738.335702:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:6156:x1875409158281984:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 366us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.335711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 10000000:01000000:3.0:1788529738.445007:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788529738.445019:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac4efb800 from 4 10000000:01000000:3.0:1788529738.445026:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529738.445089:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529738.445103:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529738.445116:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529738.445151:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.445251:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529738.445340:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529738.445441:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579008 00000100:00100000:0.0:1788529738.445452:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579008 00000100:00100000:0.0:1788529738.445523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788529738.445534:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185579008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529738.445550:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529738.445566:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b041 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.445594:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.445614:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529738.445626:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df600, rc 0) 00000100:00100000:0.0:1788529738.445682:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529738.445691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788529738.445812:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529738.445831:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.445841:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529738.446622:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788529738.447562:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529738.447860:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788529738.447948:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:2.0:1788529738.448018:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:2.0:1788529738.448034:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788529738.448141:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.448223:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.448297:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788529738.448425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579136 00000100:00100000:3.0:1788529738.448433:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579136 00000100:00100000:3.0:1788529738.448499:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788529738.448519:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.448784:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.448793:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788529738.450447:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.450521:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.450606:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.452515:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788529738.457074:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579264 00000100:00100000:3.0:1788529738.457098:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579264 00000100:00100000:3.0:1788529738.457193:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788529738.457208:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.457571:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (6965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.457580:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788529738.457757:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529738.458542:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529738.458657:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579392:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.458745:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.458795:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788529738.459003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579392 00000100:00100000:3.0:1788529738.459013:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579392 00000100:00100000:3.0:1788529738.459065:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788529738.459074:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579392:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.459327:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579392:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 252us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.459336:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788529738.459528:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579392:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788529738.459840:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788529738.459943:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788529738.460001:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788529738.460040:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788529738.460076:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:0.0:1788529738.460117:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579520:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529738.460173:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529738.460210:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.460814:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579520 00000100:00100000:2.0:1788529738.460823:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579520 00000100:00100000:2.0:1788529738.460867:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788529738.460878:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579520:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.461140:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579520:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 262us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.461148:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788529738.462484:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579520:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788529738.462702:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788529738.462723:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788529738.468614:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529738.468636:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529738.468639:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788529738.468649:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8caac4efb800 00000020:00000080:0.0:1788529738.468652:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788529738.468760:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529738.468765:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529738.468767:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788529738.468778:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:2.0:1788529738.471246:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788529738.471290:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788529738.471311:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471331:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529738.471360:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788529738.471364:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf402e800 from 4 10000000:01000000:2.0:1788529738.471367:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788529738.471425:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471434:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471449:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529738.471487:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.471583:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.471648:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579648 00000100:00100000:2.0:1788529738.471658:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579648 00000100:00100000:2.0:1788529738.471723:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788529738.471734:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185579648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529738.471752:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529738.471768:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b04f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471802:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471817:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.471827:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3c00, rc 0) 00000100:00100000:2.0:1788529738.471872:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185579648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.471879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788529738.471957:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.471988:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529738.472005:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.472015:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529738.478383:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788529738.479423:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529738.479731:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788529738.479780:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788529738.479844:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788529738.479854:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788529738.480013:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.480115:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.480198:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579776 00000100:00100000:2.0:1788529738.480208:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579776 00000100:00100000:2.0:1788529738.480259:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788529738.480269:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185579776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.480497:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185579776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.480506:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788529738.480560:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.480590:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.480631:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.480671:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.480696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185579904 00000100:00100000:2.0:1788529738.480699:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185579904 00000100:00100000:2.0:1788529738.480722:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788529738.480729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185579904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.480877:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185579904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.480885:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788529738.480938:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.480948:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185579904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529738.485768:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529738.485966:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580032:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.486089:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.486174:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580032 00000100:00100000:2.0:1788529738.486187:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580032 00000100:00100000:2.0:1788529738.486251:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788529738.486261:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185580032:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.486569:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185580032:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 308us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.486580:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788529738.486655:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.486698:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580032:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788529738.487078:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788529738.487135:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788529738.487210:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788529738.487251:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788529738.487298:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:2.0:1788529738.487330:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580160:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.487379:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.487413:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580160 00000100:00100000:2.0:1788529738.487418:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580160 00000100:00100000:2.0:1788529738.487451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788529738.487458:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185580160:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.488208:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185580160:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 748us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.488218:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788529738.488289:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.488309:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580160:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788529738.488430:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788529738.488442:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1788529738.489326:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529738.489341:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529738.489344:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788529738.489352:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabf402e800 00000020:00000080:2.0:1788529738.489355:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788529738.489854:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529738.489860:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529738.489862:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788529738.489866:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:2.0:1788529738.489974:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788529738.489986:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788529738.490001:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.490026:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529738.490041:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788529738.490044:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc80f0000 from 4 10000000:01000000:2.0:1788529738.490047:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788529738.490099:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.490108:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.490121:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529738.490153:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.490241:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.490744:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.490779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580288 00000100:00100000:2.0:1788529738.490789:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580288 00000100:00100000:2.0:1788529738.490917:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788529738.490928:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185580288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529738.490946:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529738.490964:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b05d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.490994:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.491016:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.491025:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3600, rc 0) 00000100:00100000:2.0:1788529738.491071:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185580288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.491078:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788529738.493174:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529738.493208:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.493222:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529738.493303:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.493373:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.493416:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788529738.493540:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580416 00000100:00100000:3.0:1788529738.493549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580416 00000100:00100000:3.0:1788529738.493600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788529738.493610:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185580416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529738.494640:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185580416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1027us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529738.494653:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788529738.494851:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.495012:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.495073:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.495108:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.495127:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580544 00000100:00100000:2.0:1788529738.495132:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580544 00000100:00100000:2.0:1788529738.495175:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788529738.495184:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185580544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.495427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185580544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.495434:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788529738.495475:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185580544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529738.498205:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8583:1875409185580672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529738.498324:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.498373:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580672 00000100:00100000:2.0:1788529738.498382:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580672 00000100:00100000:2.0:1788529738.498431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788529738.498441:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:8583:x1875409185580672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529738.498712:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:8583:x1875409185580672:12345-0@lo:502:llog_process_th.0 Request processed in 271us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.498720:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788529738.498787:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.498815:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8583:1875409185580672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788529738.498855:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529738.498870:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529738.498873:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788529738.498883:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabc80f0000 00000020:00000080:2.0:1788529738.498886:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788529738.499489:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8583:1875409185580800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529738.499543:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529738.499576:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580800 00000100:00100000:2.0:1788529738.499581:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580800 00000100:00100000:2.0:1788529738.499612:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788529738.499620:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:8583:x1875409185580800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529738.499791:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:8583:x1875409185580800:12345-0@lo:502:llog_process_th.0 Request processed in 172us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529738.499798:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788529738.499837:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788529738.499855:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:8583:1875409185580800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788529738.499881:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529738.499983:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529738.499986:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788529738.499992:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788529738.500057:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788529738.500067:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788529738.500079:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529738.500093:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529738.546707:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529738.546775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529738.546802:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529738.547714:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282112 00000100:00100000:0.0:1788529738.547731:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282112 00000100:00100000:0.0:1788529738.547807:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1788529738.547820:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158282112:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529738.547951:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158282112:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 132us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529738.547960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1788529738.547994:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282240 00000100:00100000:0.0:1788529738.547998:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282240 00000100:00100000:0.0:1788529738.548029:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282368 00000100:00100000:0.0:1788529738.548033:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282368 00000100:00100000:0.0:1788529738.548050:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1788529738.548056:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158282240:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529738.548087:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158282240:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 31us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529738.548093:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1788529738.548104:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1788529738.548109:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158282368:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529738.548131:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158282368:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529738.548137:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00080000:0.0:1788529738.548167:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529738.548171:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529738.548174:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529739.085217:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529740.109807:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529741.145804:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529741.389202:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185581056:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389288:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.389339:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185581568:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.389423:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788529741.389430:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185580928:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.389490:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185581440:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.389563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581056 00000100:00100000:3.0:1788529741.389571:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581056 00000100:00100000:3.0:1788529741.389616:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581440 00000100:00100000:3.0:1788529741.389619:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581440 00000100:00100000:3.0:1788529741.389653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788529741.389663:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185581056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389727:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185581056:12345-0@lo:400:kworker.0 Request processed in 65us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529741.389735:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788529741.389752:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529741.389758:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185581440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389786:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185581440:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529741.389792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529741.389812:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185581312:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.389881:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529741.389887:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185581184:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.389961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529741.390004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581184 00000100:00100000:3.0:1788529741.390007:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581184 00000100:00100000:3.0:1788529741.390030:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788529741.390036:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185581184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.390069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185581184:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529741.390075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788529741.390110:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185581184:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.390140:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185581440:0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.390150:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185581056:0@lo:400:kworker.0 00000100:00080000:3.0:1788529741.390186:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529741.390204:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581568 00000100:00100000:3.0:1788529741.390207:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581568 00000100:00100000:3.0:1788529741.390248:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581312 00000100:00100000:3.0:1788529741.390251:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581312 00000100:00100000:3.0:1788529741.390266:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788529741.390272:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185581568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.390309:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185581568:12345-0@lo:400:kworker.0 Request processed in 37us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529741.390315:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788529741.390327:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788529741.390333:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185581312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529741.390366:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185581312:12345-0@lo:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529741.390379:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788529741.390393:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529741.390396:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788529741.390413:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c0700 x1875409185581312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529741.390423:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185581312:0@lo:400:kworker.0 00010000:00080000:3.0:1788529741.390443:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c2300 x1875409185581568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529741.390451:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185581568:0@lo:400:kworker.0 00000100:00100000:2.0:1788529741.390713:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185580928 00000100:00100000:2.0:1788529741.390719:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185580928 00000100:00100000:2.0:1788529741.390764:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788529741.390771:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185580928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529741.390815:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185580928:12345-0@lo:400:kworker.0 Request processed in 45us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529741.390822:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788529741.390945:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529741.390976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529741.391013:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581696 00000100:00100000:2.0:1788529741.391018:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581696 00000100:00100000:2.0:1788529741.391043:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788529741.391050:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185581696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788529741.391084:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529741.391124:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529741.391131:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788529741.391161:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5f80 x1875409185581696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529741.391176:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529741.391203:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185580928:0@lo:400:kworker.0 00010000:00010000:3.0:1788529742.169123:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529743.181240:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529743.437729:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529743.437757:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185581824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529743.437855:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529743.437953:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581824 00000100:00100000:3.0:1788529743.437961:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581824 00000100:00100000:3.0:1788529743.438019:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788529743.438027:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185581824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529743.438060:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529743.438101:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185581824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529743.438109:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788529743.438130:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529743.438164:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc83800 x1875409185581824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529743.438183:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185581824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529743.667472:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529743.667508:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529743.667558:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529743.667837:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282496 00000100:00100000:2.0:1788529743.667853:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282496 00000100:00100000:2.0:1788529743.667941:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:2.0:1788529743.667951:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158282496:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529743.669361:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282752 00000100:00100000:3.0:1788529743.669374:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282752 00000100:00100000:3.0:1788529743.669452:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788529743.669462:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2353:x1875409158282752:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:3.0:1788529743.669499:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af84 00000100:00080000:3.0:1788529743.669511:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cabc61f6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788529743.669561:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788529743.670310:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158282496:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 2355us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529743.670324:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:3.0:1788529743.670513:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+2:2353:x1875409158282752:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 1052us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529743.670521:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788529743.670552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282624 00000100:00100000:3.0:1788529743.670559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282624 00000100:00100000:3.0:1788529743.670605:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1788529743.670613:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158282624:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529743.670651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158282624:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (3092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529743.670657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00080000:3.0:1788529743.670675:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788529743.670680:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788529743.670732:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529743.684525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529743.685946:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158282880 00000100:00100000:3.0:1788529743.685967:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158282880 00000100:00100000:3.0:1788529743.686083:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1788529743.686095:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2353:x1875409158282880:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:3.0:1788529743.686138:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af8b 00000100:00080000:3.0:1788529743.686149:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8cabc61f0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788529743.686210:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788529743.686733:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+2:2353:x1875409158282880:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 639us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529743.686742:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00010000:00010000:3.0:1788529743.686803:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788529743.690415:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788529744.205118:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529744.586597:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788529745.230768:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529746.253087:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529746.509205:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185582080:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.509315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529746.509521:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185581952:0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.509571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529746.509601:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185582464:0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.509625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529746.509681:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185581952 00000100:00100000:0.0:1788529746.509688:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185581952 00000100:00100000:0.0:1788529746.509733:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788529746.509743:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.509803:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185581952:12345-0@lo:400:kworker.0 Request processed in 61us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529746.509811:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788529746.509848:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582080 00000100:00100000:0.0:1788529746.509852:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582080 00000100:00100000:0.0:1788529746.509877:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582464 00000100:00100000:0.0:1788529746.509880:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582464 00000100:00100000:0.0:1788529746.509930:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788529746.509938:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.509972:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185582080:12345-0@lo:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529746.509977:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788529746.509990:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788529746.509996:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185582464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.510023:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185582464:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529746.510028:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788529746.510052:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529746.510081:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185581952:0@lo:400:kworker.0 00000100:00100000:0.0:1788529746.510107:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185582464:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510619:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185582080:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510629:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185582592:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510660:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529746.510712:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185582208:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529746.510766:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529746.510772:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185582336:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529746.510826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582208 00000100:00100000:3.0:1788529746.510831:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582208 00000100:00100000:3.0:1788529746.510863:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788529746.510870:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185582208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.510929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185582208:12345-0@lo:400:kworker.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529746.510936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788529746.510955:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582592 00000100:00100000:3.0:1788529746.510967:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582592 00000100:00100000:3.0:1788529746.510992:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582336 00000100:00100000:3.0:1788529746.510995:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582336 00000100:00100000:3.0:1788529746.511011:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788529746.511017:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185582592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.511052:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185582592:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529746.511058:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788529746.511070:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788529746.511076:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185582336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.511102:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185582336:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529746.511108:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788529746.511145:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc80000 x1875409185582336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529746.511157:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185582336:0@lo:400:kworker.0 00000100:00100000:3.0:1788529746.511169:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185582208:0@lo:400:kworker.0 00000100:00080000:0.0:1788529746.512217:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529746.512225:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529746.512228:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788529746.513463:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c2300 x1875409185582592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529746.513481:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185582592:0@lo:400:kworker.0 00000100:00100000:1.0:1788529746.519084:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529746.519117:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185582720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529746.519216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529746.519388:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582720 00000100:00100000:2.0:1788529746.519397:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582720 00000100:00100000:2.0:1788529746.519463:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788529746.519475:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185582720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788529746.519541:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529746.519603:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185582720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529746.519609:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788529746.519648:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5f80 x1875409185582720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529746.519667:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185582720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788529747.278923:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788529748.146479:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:3.0:1788529748.146491:0:7643:0:(genops.c:885:class_export_put()) final put ffff8cabc61f0000/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:1.0:1788529748.146734:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc61f0000/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-OST0001 00000020:00000080:1.0:1788529748.146798:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc61f0800 for lustre-OST0001 00010000:00010000:1.0:1788529748.302972:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529748.561485:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529748.561509:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185582848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529748.561582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529748.567006:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582848 00000100:00100000:0.0:1788529748.567027:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582848 00000100:00100000:1.0:1788529748.567739:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788529748.567756:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185582848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529748.567822:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529748.567936:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185582848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (6351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529748.567943:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788529748.569803:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529748.570542:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc328ea00 x1875409185582848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529748.570573:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185582848:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788529748.665198:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:3.0:1788529748.665221:0:6711:0:(genops.c:885:class_export_put()) final put ffff8cabc61f5800/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:3.0:1788529748.665267:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc61f5800/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-OST0000 00000020:00000080:3.0:1788529748.665347:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc61f6000 for lustre-OST0000 00000100:00100000:3.0:1788529748.761809:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529748.761935:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283008 00000100:00100000:2.0:1788529748.761945:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283008 00000100:00100000:2.0:1788529748.762001:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:2.0:1788529748.762012:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158283008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529748.762091:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158283008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529748.762109:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:3.0:1788529748.762337:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529748.762424:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283136 00000100:00100000:3.0:1788529748.762428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283136 00000100:00100000:3.0:1788529748.762476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1788529748.762484:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158283136:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529748.762523:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158283136:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529748.762530:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00080000:3.0:1788529748.762551:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529749.339436:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529750.349091:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788529751.353841:0:9065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing yml_node 00010000:00010000:3.0:1788529751.373360:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529751.629178:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529751.629419:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529751.629445:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185583104:0@lo:400:kworker.0 00000100:00100000:0.0:1788529751.629532:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529751.629710:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185583232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529751.629746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529751.629814:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583232 00000100:00100000:1.0:1788529751.629823:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583232 00000100:00100000:1.0:1788529751.629924:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788529751.629935:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185583232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529751.629976:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529751.630024:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185583232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529751.630030:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788529751.630072:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788529751.630109:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc328ea00 x1875409185583232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529751.630129:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185583232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529751.630359:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583104 00000100:00100000:0.0:1788529751.630364:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583104 00000100:00100000:0.0:1788529751.630409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788529751.630417:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185583104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529751.630458:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185583104:12345-0@lo:400:kworker.0 Request processed in 42us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529751.630464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788529751.630491:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185583104:0@lo:400:kworker.0 00000100:00100000:2.0:1788529751.630832:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185582976:0@lo:400:kworker.0 00000100:00100000:2.0:1788529751.630983:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529751.631268:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529751.631375:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185583616:0@lo:400:kworker.0 00000100:00100000:3.0:1788529751.631410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529751.631435:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529751.631440:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185583488:0@lo:400:kworker.0 00000100:00100000:3.0:1788529751.631465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529751.631493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583616 00000100:00100000:3.0:1788529751.631498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583616 00000100:00100000:3.0:1788529751.631539:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788529751.631548:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185583616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529751.631602:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185583616:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529751.631608:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788529751.631628:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583488 00000100:00100000:3.0:1788529751.631631:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583488 00000100:00100000:3.0:1788529751.631682:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788529751.631690:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529751.631721:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185583488:12345-0@lo:400:kworker.0 Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529751.631727:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788529751.631763:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cd500 x1875409185583488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529751.631774:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185583488:0@lo:400:kworker.0 00000100:00100000:3.0:1788529751.631785:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185583616:0@lo:400:kworker.0 00000100:00080000:1.0:1788529751.634083:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529751.634093:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529751.635531:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185582976 00000100:00100000:0.0:1788529751.635555:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185582976 00000100:00100000:0.0:1788529751.635618:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788529751.635629:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185582976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529751.635811:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185582976:12345-0@lo:400:kworker.0 Request processed in 183us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529751.635819:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788529751.635948:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185582976:0@lo:400:kworker.0 00000100:00100000:2.0:1788529751.636095:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185583360:0@lo:400:kworker.0 00000100:00100000:2.0:1788529751.636135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529751.644387:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583360 00000100:00100000:0.0:1788529751.644406:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583360 00000100:00100000:2.0:1788529751.650985:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529751.650997:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185583360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529751.651107:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185583360:12345-0@lo:400:kworker.0 Request processed in 113us (14971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529751.651126:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529751.651172:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185583360:0@lo:400:kworker.0 00000100:00080000:1.0:1788529751.651242:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529752.397774:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529753.421220:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529753.678084:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185583744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529753.678197:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529753.678392:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583744 00000100:00100000:3.0:1788529753.678402:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583744 00000100:00100000:3.0:1788529753.678474:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788529753.678483:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185583744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529753.678519:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529753.678585:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185583744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529753.678592:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788529753.678644:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cd180 x1875409185583744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529753.678663:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185583744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788529753.678870:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529753.882431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529753.882482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529753.888335:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283392 00000100:00100000:1.0:1788529753.888352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283392 00000100:00100000:1.0:1788529753.888457:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1788529753.888471:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158283392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529753.888565:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158283392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 88us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529753.888572:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1788529753.889639:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283264 00000100:00100000:0.0:1788529753.889653:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283264 00000100:00100000:0.0:1788529753.889722:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:0.0:1788529753.889732:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158283264:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529753.889801:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158283264:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 70us (7378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529753.889808:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00080000:2.0:1788529753.890144:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529754.445362:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529755.469234:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529756.493110:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529756.749314:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185584256:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749462:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788529756.749469:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185583872:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749498:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749521:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185584384:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749576:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185584000:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749614:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185584512:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749651:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529756.749656:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185584128:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.749733:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584256 00000100:00100000:0.0:1788529756.749741:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584256 00000100:00100000:0.0:1788529756.749802:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584512 00000100:00100000:0.0:1788529756.749806:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584512 00000100:00100000:0.0:1788529756.749824:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529756.749832:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749880:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185584256:12345-0@lo:400:kworker.0 Request processed in 49us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.749887:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529756.749938:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529756.749944:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185584512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.749985:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185584512:12345-0@lo:400:kworker.0 Request processed in 41us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.749991:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529756.750009:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185583872 00000100:00100000:0.0:1788529756.750012:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185583872 00000100:00100000:0.0:1788529756.750037:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788529756.750043:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185583872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750071:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185583872:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.750077:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788529756.750103:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584384 00000100:00100000:0.0:1788529756.750106:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584384 00000100:00100000:0.0:1788529756.750129:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584000 00000100:00100000:0.0:1788529756.750132:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584000 00000100:00100000:0.0:1788529756.750141:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584128 00000100:00100000:0.0:1788529756.750144:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584128 00000100:00100000:0.0:1788529756.750160:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788529756.750165:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750201:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185584384:12345-0@lo:400:kworker.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.750207:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788529756.750219:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788529756.750224:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185584000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750247:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185584000:12345-0@lo:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.750253:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788529756.750263:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788529756.750268:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185584128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750289:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185584128:12345-0@lo:400:kworker.0 Request processed in 22us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.750295:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788529756.750314:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788529756.750319:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529756.750321:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529756.750388:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185584128:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750398:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185584000:0@lo:400:kworker.0 00010000:00080000:0.0:1788529756.750409:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20700 x1875409185584512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529756.750418:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185584512:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750447:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185583872:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.750457:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185584384:0@lo:400:kworker.0 00010000:00080000:0.0:1788529756.750476:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc2e86a00 x1875409185584256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529756.750485:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185584256:0@lo:400:kworker.0 00000100:00100000:0.0:1788529756.757179:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529756.757208:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185584640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529756.757289:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529756.757341:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584640 00000100:00100000:0.0:1788529756.757572:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584640 00000100:00100000:0.0:1788529756.757631:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788529756.757642:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185584640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529756.757700:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529756.757759:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185584640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529756.757766:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788529756.757830:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20700 x1875409185584640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529756.757853:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185584640:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788529757.252341:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.5 00010000:00010000:0.0:1788529757.521317:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529758.541173:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529758.799575:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529758.799601:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185584768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529758.799678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529758.799761:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584768 00000100:00100000:3.0:1788529758.799771:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584768 00000100:00100000:3.0:1788529758.799835:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529758.799845:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185584768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529758.799886:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529758.799962:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185584768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529758.799969:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788529758.799991:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529758.800022:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cd500 x1875409185584768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529758.800042:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185584768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529759.012457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529759.012568:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529759.015479:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283648 00000100:00100000:0.0:1788529759.015499:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283648 00000100:00100000:0.0:1788529759.015621:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00080000:3.0:1788529759.015628:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529759.015636:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158283648:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529759.015749:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158283648:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 115us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529759.015757:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1788529759.019594:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283520 00000100:00100000:1.0:1788529759.019616:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283520 00000100:00100000:1.0:1788529759.019704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:1.0:1788529759.019716:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158283520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529759.019822:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158283520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 108us (7376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529759.019831:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 225 00010000:00010000:1.0:1788529759.570148:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788529760.152763:0:9355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.5 00010000:00010000:1.0:1788529760.589798:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529761.613751:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529761.869846:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529761.869877:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185584896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529761.869971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529761.870236:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185585280:0@lo:400:kworker.0 00000100:00100000:3.0:1788529761.870267:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529761.870283:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529761.870287:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185585408:0@lo:400:kworker.0 00000100:00100000:3.0:1788529761.870307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529761.870619:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185585024:0@lo:400:kworker.0 00000100:00100000:1.0:1788529761.870660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529761.870694:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185585536:0@lo:400:kworker.0 00000100:00100000:1.0:1788529761.870716:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529761.870733:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529761.870738:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185585152:0@lo:400:kworker.0 00000100:00100000:1.0:1788529761.870757:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529761.870961:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185584896 00000100:00100000:0.0:1788529761.870969:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185584896 00000100:00100000:0.0:1788529761.871033:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529761.871043:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185584896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529761.871080:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529761.871126:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185584896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529761.871133:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788529761.871156:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585280 00000100:00100000:0.0:1788529761.871160:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585280 00000100:00100000:0.0:1788529761.871185:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585536 00000100:00100000:0.0:1788529761.871188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585536 00000100:00100000:0.0:1788529761.871201:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585152 00000100:00100000:0.0:1788529761.871203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585152 00000100:00100000:0.0:1788529761.871214:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788529761.871220:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185585280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529761.871252:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185585280:12345-0@lo:400:kworker.0 Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529761.871258:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788529761.871270:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788529761.871276:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185585536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529761.871306:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185585536:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529761.871312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788529761.871323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788529761.871329:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185585152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529761.871354:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185585152:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529761.871381:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788529761.871401:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585408 00000100:00100000:0.0:1788529761.871404:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585408 00000100:00100000:0.0:1788529761.871427:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529761.871433:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185585408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529761.871463:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185585408:12345-0@lo:400:kworker.0 Request processed in 30us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529761.871468:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529761.871517:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185585152:0@lo:400:kworker.0 00000100:00100000:0.0:1788529761.871987:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185585536:0@lo:400:kworker.0 00000100:00100000:3.0:1788529761.872069:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585024 00000100:00100000:3.0:1788529761.872074:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585024 00000100:00100000:3.0:1788529761.872110:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788529761.872118:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185585024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529761.872171:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185585024:12345-0@lo:400:kworker.0 Request processed in 54us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529761.872186:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:3.0:1788529761.872240:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cdf80 x1875409185585408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529761.872252:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185585408:0@lo:400:kworker.0 00000100:00100000:3.0:1788529761.872264:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185585280:0@lo:400:kworker.0 00010000:00080000:3.0:1788529761.872278:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20700 x1875409185584896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529761.872295:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185584896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529761.872378:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185585024:0@lo:400:kworker.0 00000100:00080000:1.0:1788529761.872481:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529761.872488:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529761.872491:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788529762.637701:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788529763.133670:0:9452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.5 00010000:00010000:1.0:1788529763.663088:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529763.917272:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529763.917298:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185585664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529763.917371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529763.917652:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585664 00000100:00100000:3.0:1788529763.917661:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585664 00000100:00100000:3.0:1788529763.917735:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529763.917747:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185585664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529763.917786:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529763.917853:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185585664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529763.917860:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788529763.917957:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788529763.918100:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cdc00 x1875409185585664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529763.918132:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185585664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529764.120220:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529764.120287:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529764.120504:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283776 00000100:00100000:0.0:1788529764.120515:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283776 00000100:00100000:0.0:1788529764.120579:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:0.0:1788529764.120589:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158283776:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529764.120677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158283776:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529764.120684:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:3.0:1788529764.121228:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158283904 00000100:00100000:3.0:1788529764.121235:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158283904 00000100:00100000:3.0:1788529764.121311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:3.0:1788529764.121322:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158283904:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529764.121371:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158283904:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 50us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529764.121377:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00080000:1.0:1788529764.121739:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529764.686855:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529765.076340:0:9500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 09:49:23 EDT 2026 00010000:00010000:1.0:1788529765.715284:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529766.748327:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529766.991588:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185585920:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.991712:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185586432:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.991774:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788529766.991794:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185585792:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.991845:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.991919:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185586048:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991951:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.991967:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529766.991973:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185586176:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.991993:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529766.992025:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585920 00000100:00100000:1.0:1788529766.992033:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585920 00000100:00100000:1.0:1788529766.992079:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586304 00000100:00100000:1.0:1788529766.992082:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586304 00000100:00100000:1.0:1788529766.992103:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586048 00000100:00100000:1.0:1788529766.992106:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586048 00000100:00100000:1.0:1788529766.992122:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788529766.992130:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185585920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992186:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185585920:12345-0@lo:400:kworker.0 Request processed in 56us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992194:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788529766.992211:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788529766.992217:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185586304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992260:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185586304:12345-0@lo:400:kworker.0 Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992267:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788529766.992278:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788529766.992284:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185586048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992313:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185586048:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992318:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788529766.992336:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586432 00000100:00100000:1.0:1788529766.992340:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586432 00000100:00100000:1.0:1788529766.992374:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586176 00000100:00100000:1.0:1788529766.992378:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586176 00000100:00100000:1.0:1788529766.992393:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788529766.992399:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185586432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992428:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185586432:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992434:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788529766.992445:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788529766.992449:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185586176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992472:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185586176:12345-0@lo:400:kworker.0 Request processed in 23us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992478:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788529766.992494:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185585792 00000100:00100000:1.0:1788529766.992497:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185585792 00000100:00100000:1.0:1788529766.992521:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788529766.992528:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185585792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992554:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185585792:12345-0@lo:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529766.992560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1788529766.992592:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529766.992596:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529766.992598:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788529766.992628:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc328ca80 x1875409185586176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529766.992640:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185586176:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992651:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185586048:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992688:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185585792:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992698:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788529766.992705:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185585920:0@lo:400:kworker.0 00010000:00080000:1.0:1788529766.992713:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b2b480 x1875409185586432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529766.992722:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185586432:0@lo:400:kworker.0 00000100:00100000:0.0:1788529766.996271:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529766.996301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185586560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529766.996370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529766.997169:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586560 00000100:00100000:3.0:1788529766.997180:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586560 00000100:00100000:3.0:1788529766.997257:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529766.997269:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185586560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529766.997316:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529766.997389:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185586560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1018us total) trans 0 rc 0/0 00010000:00080000:2.0:1788529766.997434:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20a80 x1875409185586560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529766.997458:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185586560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529766.997879:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788529767.766488:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529768.786279:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529769.037713:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185586688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529769.037818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529769.039030:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586688 00000100:00100000:0.0:1788529769.039043:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586688 00000100:00100000:0.0:1788529769.039129:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788529769.039140:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185586688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529769.039178:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529769.039244:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185586688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529769.039251:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788529769.045157:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529769.045234:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cdf80 x1875409185586688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529769.045270:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185586688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529769.240630:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529769.240686:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529769.240881:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284160 00000100:00100000:1.0:1788529769.240915:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284160 00000100:00100000:1.0:1788529769.241004:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:1.0:1788529769.241016:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158284160:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529769.241102:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158284160:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529769.241110:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1788529769.241804:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284032 00000100:00100000:2.0:1788529769.241814:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284032 00000100:00100000:2.0:1788529769.241863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:2.0:1788529769.241872:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158284032:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529769.241961:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158284032:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529769.241977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00080000:3.0:1788529769.243814:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529769.805153:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529770.840063:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529771.853399:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529772.110837:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185586816:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.110952:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111435:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185587328:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111472:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111505:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788529772.111512:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185586944:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111564:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185587456:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111622:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185587072:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111645:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111662:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529772.111667:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185587200:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111714:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529772.111755:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586816 00000100:00100000:3.0:1788529772.111766:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586816 00000100:00100000:3.0:1788529772.111818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788529772.111828:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185586816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.111916:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185586816:12345-0@lo:400:kworker.0 Request processed in 68us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.111923:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788529772.111962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587328 00000100:00100000:3.0:1788529772.111966:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587328 00000100:00100000:3.0:1788529772.114636:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185586944 00000100:00100000:3.0:1788529772.114650:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185586944 00000100:00100000:3.0:1788529772.114673:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587072 00000100:00100000:3.0:1788529772.114677:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587072 00000100:00100000:3.0:1788529772.114713:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788529772.114723:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185587328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.114819:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185587328:12345-0@lo:400:kworker.0 Request processed in 98us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.114827:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788529772.114844:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788529772.114864:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185586944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.114920:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185586944:12345-0@lo:400:kworker.0 Request processed in 57us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.114928:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788529772.114940:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788529772.114947:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185587072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115499:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185587072:12345-0@lo:400:kworker.0 Request processed in 551us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.115508:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788529772.115533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587456 00000100:00100000:3.0:1788529772.115538:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587456 00000100:00100000:3.0:1788529772.115581:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587200 00000100:00100000:3.0:1788529772.115584:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587200 00000100:00100000:3.0:1788529772.115602:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529772.115608:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185587456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115648:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185587456:12345-0@lo:400:kworker.0 Request processed in 40us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.115655:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529772.115666:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529772.115673:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185587200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115717:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185587200:12345-0@lo:400:kworker.0 Request processed in 44us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529772.115723:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529772.115782:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185586944:0@lo:400:kworker.0 00010000:00080000:3.0:1788529772.115799:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cd500 x1875409185587456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529772.115826:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185587456:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115839:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185586816:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115851:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185587328:0@lo:400:kworker.0 00010000:00080000:3.0:1788529772.115914:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77ce680 x1875409185587200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529772.115924:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185587200:0@lo:400:kworker.0 00000100:00100000:3.0:1788529772.115936:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185587072:0@lo:400:kworker.0 00000100:00080000:1.0:1788529772.116087:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529772.116091:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529772.116093:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529772.116180:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185587584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529772.116219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529772.116764:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587584 00000100:00100000:1.0:1788529772.116771:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587584 00000100:00100000:1.0:1788529772.116854:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788529772.116863:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185587584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529772.116924:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529772.116987:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185587584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529772.117004:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788529772.117082:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb22d80 x1875409185587584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529772.117100:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185587584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788529772.879377:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529773.908639:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529774.159688:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185587712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529774.159794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529774.159907:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587712 00000100:00100000:3.0:1788529774.159917:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587712 00000100:00100000:3.0:1788529774.160000:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529774.160010:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185587712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529774.160059:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529774.160106:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185587712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529774.160114:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788529774.160156:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc321c700 x1875409185587712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529774.160176:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185587712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788529774.161738:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529774.363743:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529774.363806:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529774.363999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284288 00000100:00100000:1.0:1788529774.364016:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284288 00000100:00100000:1.0:1788529774.364092:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:1.0:1788529774.364105:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158284288:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529774.364202:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158284288:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529774.364210:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:0.0:1788529774.368449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284416 00000100:00100000:0.0:1788529774.368473:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284416 00000100:00100000:1.0:1788529774.369029:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1788529774.369045:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158284416:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529774.369180:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158284416:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 139us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529774.369189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00080000:1.0:1788529774.369215:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529774.925367:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529775.950411:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529776.987424:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529777.230118:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185587968:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230258:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185588480:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230314:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788529777.230321:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185587840:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230350:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230387:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185588352:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230410:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230449:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185588096:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230489:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529777.230495:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185588224:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.230550:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587968 00000100:00100000:3.0:1788529777.230558:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587968 00000100:00100000:3.0:1788529777.230615:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588352 00000100:00100000:3.0:1788529777.230619:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588352 00000100:00100000:3.0:1788529777.230644:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588096 00000100:00100000:3.0:1788529777.230647:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588096 00000100:00100000:3.0:1788529777.230664:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529777.230673:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185587968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230729:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185587968:12345-0@lo:400:kworker.0 Request processed in 58us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.230745:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529777.230762:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529777.230768:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185588352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230799:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185588352:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.230805:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529777.230818:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788529777.230823:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185588096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.230854:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185588096:12345-0@lo:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.230860:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788529777.230877:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588480 00000100:00100000:3.0:1788529777.230881:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588480 00000100:00100000:3.0:1788529777.230998:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588224 00000100:00100000:3.0:1788529777.231002:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588224 00000100:00100000:3.0:1788529777.231018:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529777.231023:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185588480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231054:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185588480:12345-0@lo:400:kworker.0 Request processed in 31us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.231060:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529777.231071:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529777.231077:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185588224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231103:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185588224:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.231109:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529777.231134:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185587840 00000100:00100000:3.0:1788529777.231139:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185587840 00000100:00100000:3.0:1788529777.231166:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788529777.231172:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185587840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231205:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185587840:12345-0@lo:400:kworker.0 Request processed in 33us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.231211:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:3.0:1788529777.231250:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529777.231254:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529777.231257:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529777.231281:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185587840:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231294:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185588352:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231304:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185587968:0@lo:400:kworker.0 00010000:00080000:3.0:1788529777.231315:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc321f100 x1875409185588480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529777.231324:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185588480:0@lo:400:kworker.0 00010000:00080000:3.0:1788529777.231357:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc321f800 x1875409185588224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529777.231365:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185588224:0@lo:400:kworker.0 00000100:00100000:3.0:1788529777.231375:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185588096:0@lo:400:kworker.0 00000100:00100000:0.0:1788529777.236453:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788529777.239082:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185588608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529777.239164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529777.239430:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588608 00000100:00100000:3.0:1788529777.239440:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588608 00000100:00100000:3.0:1788529777.239501:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788529777.239512:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185588608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529777.239925:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529777.239988:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185588608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 478us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529777.239996:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788529777.240111:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b2b480 x1875409185588608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529777.240131:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185588608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788529778.000872:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529779.021627:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529779.283066:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185588736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529779.283139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529779.283229:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588736 00000100:00100000:3.0:1788529779.283236:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588736 00000100:00100000:3.0:1788529779.283286:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529779.283295:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185588736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529779.283329:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529779.283371:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185588736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529779.283378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788529779.283398:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529779.283507:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc321ce00 x1875409185588736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529779.283524:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185588736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529779.479714:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529779.479806:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284544 00000100:00100000:0.0:1788529779.479817:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284544 00000100:00100000:0.0:1788529779.479877:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:0.0:1788529779.479887:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158284544:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529779.479990:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2354:x1875409158284544:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 104us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529779.479997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:3.0:1788529779.483920:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529779.484031:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284672 00000100:00100000:0.0:1788529779.484041:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284672 00000100:00100000:0.0:1788529779.484135:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1788529779.484164:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158284672:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529779.484245:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158284672:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529779.484253:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00080000:3.0:1788529779.484365:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529780.046051:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529781.069290:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529782.103606:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529782.350996:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529782.351034:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529782.351145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529782.351340:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588864 00000100:00100000:1.0:1788529782.351352:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588864 00000100:00100000:1.0:1788529782.351439:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529782.351454:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185588864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529782.351535:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529782.351607:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185588864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529782.351615:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788529782.351670:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b2b800 x1875409185588864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529782.351695:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185588864:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788529782.351851:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529782.356597:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185588992:0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.356716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529782.356782:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185589504:0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.356817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529782.356855:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529782.356862:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185589376:0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.356890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529782.356952:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589504 00000100:00100000:1.0:1788529782.356963:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589504 00000100:00100000:1.0:1788529782.357039:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788529782.357052:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.357120:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185589504:12345-0@lo:400:kworker.0 Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529782.357265:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788529782.357296:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589376 00000100:00100000:1.0:1788529782.357300:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589376 00000100:00100000:1.0:1788529782.357332:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529782.357338:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185589376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.357395:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185589376:12345-0@lo:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529782.357401:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788529782.357421:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529782.357427:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788529782.357468:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60e5880 x1875409185589376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529782.357485:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185589376:0@lo:400:kworker.0 00000100:00100000:1.0:1788529782.357499:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185589504:0@lo:400:kworker.0 00000100:00100000:2.0:1788529782.357692:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185588992 00000100:00100000:2.0:1788529782.357698:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185588992 00000100:00100000:2.0:1788529782.357754:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788529782.357763:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185588992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529782.357809:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185588992:12345-0@lo:400:kworker.0 Request processed in 47us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529782.357815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788529782.358080:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185588992:0@lo:400:kworker.0 00000100:00100000:3.0:1788529782.358399:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185589120:0@lo:400:kworker.0 00000100:00100000:3.0:1788529782.358446:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529782.358485:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529782.358492:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185589248:0@lo:400:kworker.0 00000100:00100000:3.0:1788529782.358548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529782.358638:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589120 00000100:00100000:2.0:1788529782.358644:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589120 00000100:00100000:2.0:1788529782.358686:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589248 00000100:00100000:2.0:1788529782.358689:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589248 00000100:00100000:2.0:1788529782.358733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788529782.358752:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185589120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529782.358801:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185589120:12345-0@lo:400:kworker.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529782.358809:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788529782.358823:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788529782.358830:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185589248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529782.358868:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185589248:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529782.358874:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788529782.359155:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185589248:0@lo:400:kworker.0 00000100:00100000:3.0:1788529782.359165:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185589120:0@lo:400:kworker.0 00000100:00080000:1.0:1788529782.360270:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788529782.589365:0:10131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:49:40 (1788529780) === 00000100:00100000:2.0:1788529783.015285:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.015756:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284800 00000100:00100000:3.0:1788529783.015773:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284800 00000100:00100000:3.0:1788529783.015852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1788529783.015865:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:8157:x1875409158284800:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788529783.015889:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529783.015983:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7a00/0xaa46022e3f18b06b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0cdd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529783.016022:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7a00/0xaa46022e3f18b06b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cdd expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529783.016036:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd7a00/0xaa46022e3f18b06b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cdd expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529783.016047:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7a00, rc 0) 00000100:00100000:3.0:1788529783.016132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+11:8157:x1875409158284800:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 270us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529783.016140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1788529783.028228:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.028346:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158284928 00000100:00100000:1.0:1788529783.028362:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158284928 00000100:00100000:1.0:1788529783.028436:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:1.0:1788529783.028448:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+11:8157:x1875409158284928:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788529783.028818:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+11:8157:x1875409158284928:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 371us (602us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529783.028828:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:0.0:1788529783.034700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.034946:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285056 00000100:00100000:2.0:1788529783.034972:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285056 00000100:00100000:2.0:1788529783.035049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:2.0:1788529783.035063:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+11:8157:x1875409158285056:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788529783.035085:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529783.035114:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e3800/0xaa46022e3f18b072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ce4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.035167:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e3800/0xaa46022e3f18b072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ce4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.035183:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e3800/0xaa46022e3f18b072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ce4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.035205:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e3800, rc 0) 00000100:00100000:2.0:1788529783.035289:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285056:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 228us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.035297:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:2.0:1788529783.053168:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.054212:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285184 00000100:00100000:3.0:1788529783.054228:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285184 00000100:00100000:3.0:1788529783.054308:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:3.0:1788529783.054322:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285184:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788529783.054774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285184:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 454us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529783.054784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:3.0:1788529783.056765:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.057025:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285312 00000100:00100000:1.0:1788529783.057037:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285312 00000100:00100000:1.0:1788529783.057105:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:1.0:1788529783.057117:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285312:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788529783.057406:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285312:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 290us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529783.057653:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:0.0:1788529783.061447:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.061578:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285440 00000100:00100000:2.0:1788529783.061592:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285440 00000100:00100000:2.0:1788529783.061696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:2.0:1788529783.062249:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8161:x1875409158285440:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788529783.062927:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8161:x1875409158285440:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 1217us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.062938:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:2.0:1788529783.083589:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.083713:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285568 00000100:00100000:1.0:1788529783.083740:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285568 00000100:00100000:1.0:1788529783.083814:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:1.0:1788529783.083827:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8161:x1875409158285568:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788529783.084253:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8161:x1875409158285568:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 427us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529783.084263:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:0.0:1788529783.091299:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.091430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285696 00000100:00100000:2.0:1788529783.091444:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285696 00000100:00100000:2.0:1788529783.091531:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:2.0:1788529783.091544:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+12:8157:x1875409158285696:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788529783.091567:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529783.091594:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d0e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.091633:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d0e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.091648:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d0e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529783.091661:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc32e2600, rc 0) 00000100:00100000:2.0:1788529783.091751:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:8157:x1875409158285696:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 209us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.091759:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:0.0:1788529783.100331:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.100451:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285824 00000100:00100000:3.0:1788529783.100466:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285824 00000100:00100000:3.0:1788529783.100547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:3.0:1788529783.100560:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:8157:x1875409158285824:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788529783.100595:0:5823:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788529783.100627:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788529783.100632:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788529783.100635:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788529783.100638:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788529783.103049:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:8157:x1875409158285824:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 2477us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.103067:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:0.0:1788529783.107261:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.107378:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158285952 00000100:00100000:1.0:1788529783.107392:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158285952 00000100:00100000:1.0:1788529783.107465:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:1.0:1788529783.107478:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:8157:x1875409158285952:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788529783.107510:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529783.107538:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529783.107580:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529783.107594:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529783.107605:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529783.107685:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8157:x1875409158285952:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 209us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529783.107692:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:0.0:1788529783.110574:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.110694:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286080 00000100:00100000:2.0:1788529783.110739:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286080 00000100:00100000:2.0:1788529783.110811:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 245 00000100:00100000:2.0:1788529783.110824:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8157:x1875409158286080:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788529783.111254:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8157:x1875409158286080:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 431us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.111263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 245 00000100:00100000:3.0:1788529783.113253:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.113402:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286208 00000100:00100000:2.0:1788529783.113414:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286208 00000100:00100000:2.0:1788529783.113478:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:2.0:1788529783.113490:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8157:x1875409158286208:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788529783.113997:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8157:x1875409158286208:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 506us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.114006:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:0.0:1788529783.117490:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:1.0:1788529783.117597:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529783.117851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286336 00000100:00100000:3.0:1788529783.117865:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286336 00000100:00100000:3.0:1788529783.117947:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:3.0:1788529783.117959:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8165:x1875409158286336:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788529783.118972:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8165:x1875409158286336:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 1008us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529783.118986:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:0.0:1788529783.126621:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529783.126746:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286464 00000100:00100000:2.0:1788529783.126764:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286464 00000100:00100000:2.0:1788529783.126845:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 248 00000100:00100000:2.0:1788529783.126858:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8165:x1875409158286464:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788529783.127396:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:8165:x1875409158286464:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 539us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.127406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 248 00000100:00100000:1.0:1788529783.131308:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.131351:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.131465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286976 00000100:00100000:3.0:1788529783.131478:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286976 00000100:00100000:3.0:1788529783.131567:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286592 00000100:00100000:3.0:1788529783.131570:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286592 00000100:00100000:3.0:1788529783.131590:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:3.0:1788529783.131601:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158286976:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529783.131703:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158286976:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 104us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529783.131857:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1788529783.131864:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1875409158286592:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788529783.131929:0:7603:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 38bca45c-488d-404b-89e3-533f2a694da6@192.168.201.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:0.0:1788529783.131979:0:7603:0:(genops.c:1385:class_connect()) connect: client 38bca45c-488d-404b-89e3-533f2a694da6, cookie 0xaa46022e3f18b087 00000004:00100000:0.0:1788529783.132017:0:7603:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788529783.132197:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00080000:1.0:1788529783.132271:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788529783.133419:0:7603:0:(import.c:65:import_set_state_nolock()) ffff8cabc8532800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788529783.133656:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+6:2353:x1875409158286592:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 1788us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529783.133666:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1788529783.146556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529783.146612:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.146734:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286720 00000100:00100000:3.0:1788529783.146749:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286720 00000100:00100000:3.0:1788529783.146842:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158286848 00000100:00100000:3.0:1788529783.146846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158286848 00000100:00100000:3.0:1788529783.146879:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1788529783.146891:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+7:0:x1875409158286720:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788529783.146993:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788529783.147265:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529783.147662:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788529783.147675:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+7:8157:x1875409158286848:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788529783.147696:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788529783.147757:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+7:8157:x1875409158286848:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 85us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529783.147784:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1788529783.148093:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:0:x1875409158286720:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 1204us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529783.148102:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788529783.156038:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529783.156299:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287104 00000100:00100000:0.0:1788529783.156312:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287104 00000100:00100000:0.0:1788529783.156398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1788529783.156412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+6:8157:x1875409158287104:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788529783.156544:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+6:8157:x1875409158287104:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 133us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529783.156553:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1788529783.160768:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529783.160934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287488 00000100:00100000:0.0:1788529783.160948:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287488 00000100:00100000:0.0:1788529783.161025:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1788529783.161037:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:8157:x1875409158287488:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788529783.161259:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788529783.161263:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529783.161320:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529783.161385:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:8157:x1875409158287488:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 344us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529783.161402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1788529783.161405:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287232 00000100:00100000:1.0:1788529783.161411:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287232 00000100:00100000:2.0:1788529783.161490:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287360 00000100:00100000:2.0:1788529783.161505:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287360 00000100:00100000:2.0:1788529783.161543:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1788529783.161550:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875409158287360:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788529783.161585:0:6687:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 38bca45c-488d-404b-89e3-533f2a694da6@192.168.201.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1788529783.161643:0:6687:0:(genops.c:1385:class_connect()) connect: client 38bca45c-488d-404b-89e3-533f2a694da6, cookie 0xaa46022e3f18b08e 00002000:00100000:2.0:1788529783.161657:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38bca45c-488d-404b-89e3-533f2a694da6/ffff8cabc3e14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788529783.161671:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788529783.162014:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788529783.164881:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e10000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788529783.164999:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2353:x1875409158287360:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 3442us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.165011:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:2.0:1788529783.165055:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1788529783.165062:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875409158287232:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788529783.165093:0:6687:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 38bca45c-488d-404b-89e3-533f2a694da6@192.168.201.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1788529783.165133:0:6687:0:(genops.c:1385:class_connect()) connect: client 38bca45c-488d-404b-89e3-533f2a694da6, cookie 0xaa46022e3f18b095 00002000:00100000:2.0:1788529783.165148:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 38bca45c-488d-404b-89e3-533f2a694da6/ffff8cabc3e11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788529783.165176:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788529783.165447:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788529783.165473:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788529783.165515:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2353:x1875409158287232:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 451us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529783.165523:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000001:00100000:3.0:1788529783.436366:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00000001:00100000:3.0:1788529783.974754:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00010000:00010000:2.0:1788529784.143070:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529784.400913:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185589632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529784.401020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529784.404415:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589632 00000100:00100000:3.0:1788529784.404435:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589632 00000100:00100000:3.0:1788529784.404539:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788529784.404551:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185589632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529784.404586:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529784.404686:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185589632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (3666us total) trans 0 rc 0/0 00000100:00080000:0.0:1788529784.406929:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529784.407444:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788529784.411532:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb22d80 x1875409185589632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529784.411577:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185589632:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788529784.496102:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00010000:00010000:1.0:1788529785.167065:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529786.190975:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529787.213416:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529787.469244:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529787.469280:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185589760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529787.469397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529787.470190:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589760 00000100:00100000:1.0:1788529787.470203:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589760 00000100:00100000:1.0:1788529787.470298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788529787.470311:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185589760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529787.470369:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529787.470655:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185589760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529787.470663:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788529787.470728:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b2aa00 x1875409185589760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529787.470754:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185589760:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788529787.471598:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529787.472337:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185590144:0@lo:400:kworker.0 00000100:00100000:2.0:1788529787.472448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529787.472605:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529787.472612:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185590272:0@lo:400:kworker.0 00000100:00100000:2.0:1788529787.472667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529787.472711:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590272 00000100:00100000:2.0:1788529787.472720:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590272 00000100:00100000:2.0:1788529787.472790:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788529787.472800:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185590272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529787.472853:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185590272:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529787.472861:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788529787.472929:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590144 00000100:00100000:0.0:1788529787.472934:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590144 00000100:00100000:0.0:1788529787.472971:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788529787.472987:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529787.473026:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185590144:12345-0@lo:400:kworker.0 Request processed in 41us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529787.473032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788529787.473084:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788529787.473089:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529787.473295:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb21180 x1875409185590272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529787.473310:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185590272:0@lo:400:kworker.0 00000100:00100000:2.0:1788529787.473322:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185590144:0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.473605:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185589888:0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.473659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529787.473696:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185590400:0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.473722:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529787.473749:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529787.473755:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185590016:0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.473779:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529787.473811:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590400 00000100:00100000:3.0:1788529787.473816:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590400 00000100:00100000:3.0:1788529787.473859:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590016 00000100:00100000:3.0:1788529787.473865:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590016 00000100:00100000:3.0:1788529787.473925:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788529787.473933:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185590400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.473974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185590400:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529787.473981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788529787.473994:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788529787.474001:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185590016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529787.474026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185590016:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529787.474400:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788529787.474724:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529787.474776:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185590016:0@lo:400:kworker.0 00000100:00100000:2.0:1788529787.474790:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185590400:0@lo:400:kworker.0 00000100:00100000:0.0:1788529787.475033:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185589888 00000100:00100000:0.0:1788529787.475039:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185589888 00000100:00100000:0.0:1788529787.475083:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788529787.475092:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185589888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529787.475157:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185589888:12345-0@lo:400:kworker.0 Request processed in 67us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529787.475164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788529787.475620:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185589888:0@lo:400:kworker.0 00000100:00100000:1.0:1788529788.189753:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529788.189809:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529788.189858:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529788.190141:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287744 00000100:00100000:2.0:1788529788.190154:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287744 00000100:00100000:2.0:1788529788.190241:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:2.0:1788529788.190254:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158287744:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529788.190355:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158287744:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 103us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529788.190363:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00080000:2.0:1788529788.190401:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529788.190613:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288000 00000100:00100000:3.0:1788529788.190619:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288000 00000100:00100000:3.0:1788529788.190676:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1788529788.190686:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158288000:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529788.190724:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158288000:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529788.190731:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1788529788.191574:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529788.191644:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529788.191678:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287872 00000100:00100000:1.0:1788529788.191679:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288128 00000100:00100000:1.0:1788529788.191687:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288128 00000100:00100000:3.0:1788529788.191688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287872 00000100:00100000:3.0:1788529788.191743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:1.0:1788529788.191751:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1788529788.191757:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158287872:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529788.191767:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158288128:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529788.191820:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158287872:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529788.191828:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00080000:2.0:1788529788.191849:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788529788.191863:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788529788.191867:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529788.192417:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158287616 00000100:00100000:0.0:1788529788.192424:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158287616 00000100:00100000:0.0:1788529788.192471:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 250 00000100:00100000:0.0:1788529788.192480:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158287616:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529788.192561:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158288128:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 799us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529788.192570:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1788529788.198479:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158287616:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 5978us (8598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529788.198500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 250 00010000:00010000:1.0:1788529788.237415:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529789.263990:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529789.518094:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529789.518128:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185590528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529789.518196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529789.518254:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590528 00000100:00100000:0.0:1788529789.518261:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590528 00000100:00100000:0.0:1788529789.518315:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788529789.518337:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185590528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529789.518371:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529789.518442:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185590528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529789.518449:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788529789.518470:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788529789.518498:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb23480 x1875409185590528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529789.518516:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185590528:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788529789.989963:0:10328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788529790.285586:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529791.309500:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529792.333135:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529792.590189:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185591040:0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.590307:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185590784:0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.590374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529792.590422:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185591296:0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.590443:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529792.590473:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788529792.590478:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185590656:0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.590501:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529792.590517:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185591168:0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.590545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529792.590626:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529792.590654:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529792.590660:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185590912:0@lo:400:kworker.0 00000100:00100000:3.0:1788529792.590701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529792.590732:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591296 00000100:00100000:3.0:1788529792.590738:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591296 00000100:00100000:3.0:1788529792.590791:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591040 00000100:00100000:3.0:1788529792.590794:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591040 00000100:00100000:3.0:1788529792.590809:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788529792.590823:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529792.590871:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185591296:12345-0@lo:400:kworker.0 Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529792.590877:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788529792.590928:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529792.590934:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185591040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529792.591077:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185591040:12345-0@lo:400:kworker.0 Request processed in 143us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529792.591083:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529792.591419:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590784 00000100:00100000:3.0:1788529792.591423:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590784 00000100:00100000:3.0:1788529792.591490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591168 00000100:00100000:3.0:1788529792.591494:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591168 00000100:00100000:1.0:1788529792.591661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185591424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529792.591697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529792.592109:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590912 00000100:00100000:0.0:1788529792.592124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590912 00000100:00100000:0.0:1788529792.592152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788529792.592160:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185590784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.592199:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185590784:12345-0@lo:400:kworker.0 Request processed in 41us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529792.592283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788529792.592338:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788529792.592346:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185591168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.592379:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185591168:12345-0@lo:400:kworker.0 Request processed in 35us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529792.592384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788529792.592397:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788529792.592402:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185590912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529792.592425:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185590912:12345-0@lo:400:kworker.0 Request processed in 23us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529792.592430:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788529792.592447:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591424 00000100:00100000:0.0:1788529792.592450:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591424 00000100:00100000:0.0:1788529792.592482:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788529792.592488:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185591424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529792.592515:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529792.592692:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185591424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529792.592699:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788529792.592737:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b28380 x1875409185591424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529792.592756:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185591424:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788529792.592971:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529792.592976:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529792.592978:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529792.592999:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185590912:0@lo:400:kworker.0 00010000:00080000:1.0:1788529792.593012:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cca80 x1875409185591040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529792.593020:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185591040:0@lo:400:kworker.0 00000100:00100000:1.0:1788529792.593045:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185591168:0@lo:400:kworker.0 00000100:00100000:1.0:1788529792.593055:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185590784:0@lo:400:kworker.0 00010000:00080000:1.0:1788529792.593065:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cd880 x1875409185591296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529792.593073:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185591296:0@lo:400:kworker.0 00000100:00100000:3.0:1788529792.593356:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185590656 00000100:00100000:3.0:1788529792.593361:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185590656 00000100:00100000:3.0:1788529792.593388:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788529792.593395:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185590656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529792.593440:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185590656:12345-0@lo:400:kworker.0 Request processed in 45us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529792.593446:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788529792.593475:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185590656:0@lo:400:kworker.0 00000100:00100000:2.0:1788529793.316469:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529793.316501:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529793.316528:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529793.316543:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529793.316564:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529793.316963:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288256 00000100:00100000:0.0:1788529793.316975:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288256 00000100:00100000:0.0:1788529793.317026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:0.0:1788529793.317042:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158288256:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529793.317102:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158288256:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 63us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529793.317109:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:0.0:1788529793.317138:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288768 00000100:00100000:0.0:1788529793.317142:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288768 00000100:00100000:0.0:1788529793.317171:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288640 00000100:00100000:0.0:1788529793.317173:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288640 00000100:00100000:0.0:1788529793.317186:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:0.0:1788529793.317192:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288768:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529793.317218:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288768:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529793.317224:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:0.0:1788529793.317234:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1788529793.317241:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288640:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529793.317262:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288640:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 22us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529793.317268:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00080000:0.0:1788529793.317402:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529793.317406:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529793.319026:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288512 00000100:00100000:3.0:1788529793.319036:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288512 00000100:00100000:3.0:1788529793.319083:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288384 00000100:00100000:3.0:1788529793.319086:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288384 00000100:00100000:3.0:1788529793.319111:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1788529793.319118:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288512:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529793.319182:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158288512:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 65us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529793.319189:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1788529793.319201:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:3.0:1788529793.319208:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158288384:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529793.319229:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158288384:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 22us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529793.319235:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00080000:0.0:1788529793.319473:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788529793.357462:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529794.383425:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529794.639768:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529794.639794:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529794.639874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529794.640082:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591552 00000100:00100000:3.0:1788529794.640091:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591552 00000100:00100000:3.0:1788529794.640157:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529794.640167:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185591552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529794.640264:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529794.640345:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185591552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529794.640353:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788529794.640395:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc0e00 x1875409185591552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529794.640413:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185591552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788529794.640720:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788529795.405161:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529796.429538:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529797.462292:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529797.709295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529797.709318:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185591680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529797.709380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529797.709452:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591680 00000100:00100000:3.0:1788529797.709459:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591680 00000100:00100000:3.0:1788529797.709517:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788529797.709533:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185591680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529797.709565:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529797.709606:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185591680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529797.709613:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788529797.709651:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb21500 x1875409185591680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529797.709667:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185591680:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788529797.709829:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788529797.709966:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185591936:0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.709994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529797.710013:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529797.710018:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.710044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529797.710069:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591936 00000100:00100000:0.0:1788529797.710073:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591936 00000100:00100000:0.0:1788529797.710096:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592064 00000100:00100000:0.0:1788529797.710098:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592064 00000100:00100000:0.0:1788529797.710118:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788529797.710124:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.710165:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185591936:12345-0@lo:400:kworker.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529797.710172:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788529797.710186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788529797.710191:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185592064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.710213:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185592064:12345-0@lo:400:kworker.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529797.710219:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788529797.710239:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529797.710266:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.710274:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185591936:0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710383:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185592192:0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529797.710435:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788529797.710440:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185591808:0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529797.710483:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185592320:0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710510:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529797.710531:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185591808 00000100:00100000:2.0:1788529797.710535:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185591808 00000100:00100000:2.0:1788529797.710559:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788529797.710565:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185591808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710596:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185591808:12345-0@lo:400:kworker.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529797.710610:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788529797.710639:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592320 00000100:00100000:2.0:1788529797.710642:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592320 00000100:00100000:2.0:1788529797.710663:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788529797.710668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185592320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710691:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185592320:12345-0@lo:400:kworker.0 Request processed in 24us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529797.710697:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788529797.710709:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529797.710734:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185591808:0@lo:400:kworker.0 00000100:00100000:2.0:1788529797.710743:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.711802:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592192 00000100:00100000:0.0:1788529797.711810:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592192 00000100:00100000:0.0:1788529797.711859:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788529797.711866:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529797.711927:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185592192:12345-0@lo:400:kworker.0 Request processed in 61us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529797.711933:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788529797.711962:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20700 x1875409185592192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529797.711982:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185592192:0@lo:400:kworker.0 00000100:00080000:2.0:1788529797.712250:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529798.446804:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529798.446859:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529798.446889:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529798.446959:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529798.447003:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529798.447093:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289408 00000100:00100000:1.0:1788529798.447104:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289408 00000100:00100000:1.0:1788529798.447178:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289280 00000100:00100000:1.0:1788529798.447182:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289280 00000100:00100000:1.0:1788529798.447202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1788529798.447212:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289408:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529798.447306:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289408:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 96us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529798.447315:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1788529798.447332:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1788529798.447339:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289280:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529798.447363:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289280:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529798.447369:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1788529798.447992:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158288896 00000100:00100000:3.0:1788529798.447998:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158288896 00000100:00100000:3.0:1788529798.448037:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00100000:3.0:1788529798.448044:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158288896:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529798.448078:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158288896:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 35us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529798.448084:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00080000:2.0:1788529798.448467:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788529798.448471:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788529798.449162:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289152 00000100:00100000:0.0:1788529798.449169:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289152 00000100:00100000:0.0:1788529798.449217:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289024 00000100:00100000:0.0:1788529798.449220:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289024 00000100:00100000:0.0:1788529798.449255:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1788529798.449262:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529798.449307:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158289152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 46us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529798.449313:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1788529798.449326:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:0.0:1788529798.449332:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158289024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529798.449354:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158289024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 22us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529798.449359:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00080000:2.0:1788529798.449848:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788529798.477183:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529799.508586:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529799.758601:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529799.758625:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185592448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529799.758691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529799.758756:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592448 00000100:00100000:3.0:1788529799.758763:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592448 00000100:00100000:3.0:1788529799.758815:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788529799.758825:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185592448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529799.758862:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529799.758925:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185592448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529799.758946:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788529799.758966:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529799.758995:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc3800 x1875409185592448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529799.759013:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185592448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788529800.525224:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529801.549954:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529802.574112:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529802.830349:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185592704:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.830443:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529802.830523:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185593216:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.830581:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529802.830612:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788529802.830618:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185592832:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.830640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529802.830657:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185593344:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.830678:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529802.830712:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592704 00000100:00100000:2.0:1788529802.830720:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592704 00000100:00100000:2.0:1788529802.830978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788529802.830990:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185592704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.831919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529802.831965:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529802.831995:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185593088:0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832018:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529802.832054:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529802.832061:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185592960:0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832084:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529802.832120:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593344 00000100:00100000:1.0:1788529802.832126:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593344 00000100:00100000:1.0:1788529802.832178:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593088 00000100:00100000:1.0:1788529802.832181:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593088 00000100:00100000:1.0:1788529802.832209:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788529802.832217:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185593344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832257:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185593344:12345-0@lo:400:kworker.0 Request processed in 42us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832265:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788529802.832281:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788529802.832287:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185593088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832318:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185593088:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832323:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788529802.832351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592576 00000100:00100000:1.0:1788529802.832354:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592576 00000100:00100000:1.0:1788529802.832376:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788529802.832382:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185592576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529802.832410:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529802.832441:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185592576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832447:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788529802.832467:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593216 00000100:00100000:1.0:1788529802.832470:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593216 00000100:00100000:1.0:1788529802.832496:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592832 00000100:00100000:1.0:1788529802.832499:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592832 00000100:00100000:1.0:1788529802.832509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185592960 00000100:00100000:1.0:1788529802.832511:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185592960 00000100:00100000:1.0:1788529802.832522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788529802.832527:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185593216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832554:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185593216:12345-0@lo:400:kworker.0 Request processed in 27us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788529802.832579:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788529802.832585:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185592832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832611:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185592832:12345-0@lo:400:kworker.0 Request processed in 27us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832616:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788529802.832626:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788529802.832631:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185592960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.832654:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185592960:12345-0@lo:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529802.832660:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788529802.832674:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529802.832678:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529802.832680:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529802.832716:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185592960:0@lo:400:kworker.0 00010000:00080000:1.0:1788529802.832728:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20700 x1875409185592576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529802.832742:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185592576:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788529802.832752:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2b100 x1875409185593088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529802.832934:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185592704:12345-0@lo:400:kworker.0 Request processed in 1945us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529802.832943:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788529802.832996:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185592832:0@lo:400:kworker.0 00010000:00080000:2.0:1788529802.833006:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2a300 x1875409185593344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529802.833014:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185593344:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.833024:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185592704:0@lo:400:kworker.0 00000100:00100000:2.0:1788529802.833236:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185593216:0@lo:400:kworker.0 00000100:00100000:1.0:1788529802.834950:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185593088:0@lo:400:kworker.0 00000100:00100000:1.0:1788529803.559830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529803.559883:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529803.560042:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289920 00000100:00100000:3.0:1788529803.560053:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289920 00000100:00100000:3.0:1788529803.560114:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290048 00000100:00100000:3.0:1788529803.560118:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290048 00000100:00100000:3.0:1788529803.560147:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788529803.560158:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2353:x1875409158289920:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:3.0:1788529803.560186:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b095 00000100:00080000:3.0:1788529803.560196:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e17000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788529803.560231:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788529803.560566:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+2:2353:x1875409158289920:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 410us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529803.560574:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788529803.560589:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1788529803.560596:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2353:x1875409158290048:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:3.0:1788529803.560606:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b08e 00000100:00080000:3.0:1788529803.560611:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e10000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788529803.560628:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788529803.560817:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38bca45c-488d-404b-89e3-533f2a694da6+2:2353:x1875409158290048:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 220us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529803.560824:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:1.0:1788529803.561258:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529803.561268:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788529803.561395:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529803.561623:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529803.576620:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529803.576670:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529803.576712:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529803.576839:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289536 00000100:00100000:2.0:1788529803.576851:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289536 00000100:00100000:2.0:1788529803.576937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 256 00000100:00100000:2.0:1788529803.576947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158289536:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529803.577037:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158289536:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529803.577044:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 256 00000100:00100000:1.0:1788529803.577377:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289664 00000100:00100000:1.0:1788529803.577382:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289664 00000100:00100000:1.0:1788529803.577428:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158289792 00000100:00100000:1.0:1788529803.577431:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158289792 00000100:00100000:1.0:1788529803.577463:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:1.0:1788529803.577472:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158289664:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529803.577512:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158289664:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529803.577518:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:1.0:1788529803.577532:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:1.0:1788529803.577538:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158289792:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529803.577563:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158289792:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529803.577568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00080000:2.0:1788529803.577940:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788529803.597080:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788529804.424492:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00000020:00000080:2.0:1788529804.424501:0:7643:0:(genops.c:885:class_export_put()) final put ffff8cabc3e14800/38bca45c-488d-404b-89e3-533f2a694da6 00000020:00000080:0.0:1788529804.424575:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc3e14800/38bca45c-488d-404b-89e3-533f2a694da6 for lustre-OST0001 00000020:00000080:0.0:1788529804.424627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc3e10000 for lustre-OST0001 00010000:00010000:0.0:1788529804.622024:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529804.882397:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185593472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529804.882468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529804.882541:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593472 00000100:00100000:3.0:1788529804.882549:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593472 00000100:00100000:3.0:1788529804.882609:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788529804.882618:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185593472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529804.882651:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529804.882707:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185593472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529804.882715:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788529804.882755:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc3800 x1875409185593472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529804.882776:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185593472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788529804.894072:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788529805.056465:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00000020:00000080:1.0:1788529805.056475:0:6711:0:(genops.c:885:class_export_put()) final put ffff8cabc3e11800/38bca45c-488d-404b-89e3-533f2a694da6 00000020:00000080:3.0:1788529805.058271:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc3e11800/38bca45c-488d-404b-89e3-533f2a694da6 for lustre-OST0000 00000020:00000080:3.0:1788529805.058330:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc3e17000 for lustre-OST0000 00010000:00010000:1.0:1788529805.656036:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529806.669467:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529807.693987:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529807.949181:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185593728:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529807.949308:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185594240:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529807.949366:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529807.949372:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185593856:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949393:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529807.949424:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594240 00000100:00100000:2.0:1788529807.949431:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594240 00000100:00100000:2.0:1788529807.949483:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788529807.949493:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949541:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185594240:12345-0@lo:400:kworker.0 Request processed in 50us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.949548:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788529807.949574:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593728 00000100:00100000:2.0:1788529807.949578:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593728 00000100:00100000:2.0:1788529807.949600:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593856 00000100:00100000:2.0:1788529807.949603:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593856 00000100:00100000:2.0:1788529807.949624:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788529807.949631:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185593728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949669:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185593728:12345-0@lo:400:kworker.0 Request processed in 39us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.949675:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788529807.949688:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788529807.949694:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185593856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949721:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185593856:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.949727:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788529807.949771:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185593856:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.949782:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185593728:0@lo:400:kworker.0 00010000:00080000:2.0:1788529807.949792:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3df80 x1875409185594240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529807.949803:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185594240:0@lo:400:kworker.0 00000100:00100000:3.0:1788529807.949891:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185593600:0@lo:400:kworker.0 00000100:00100000:3.0:1788529807.949953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529807.949976:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185594112:0@lo:400:kworker.0 00000100:00100000:3.0:1788529807.949998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529807.950014:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529807.950019:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185593984:0@lo:400:kworker.0 00000100:00100000:3.0:1788529807.950041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788529807.950061:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788529807.950074:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529807.950322:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594112 00000100:00100000:1.0:1788529807.950327:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594112 00000100:00100000:1.0:1788529807.950357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788529807.950363:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185594112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529807.950560:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185594112:12345-0@lo:400:kworker.0 Request processed in 197us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529807.950567:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788529807.950582:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529807.950631:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185594112:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.952361:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593600 00000100:00100000:2.0:1788529807.952368:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593600 00000100:00100000:2.0:1788529807.952414:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788529807.952422:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185593600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.952485:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185593600:12345-0@lo:400:kworker.0 Request processed in 64us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.952492:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788529807.952526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185593984 00000100:00100000:2.0:1788529807.952530:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185593984 00000100:00100000:2.0:1788529807.952562:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529807.952569:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185593984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.952611:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185593984:12345-0@lo:400:kworker.0 Request processed in 42us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.952617:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529807.952641:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185594368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529807.952668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529807.952701:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594368 00000100:00100000:2.0:1788529807.952705:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594368 00010000:00080000:3.0:1788529807.952706:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3c380 x1875409185593984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529807.952718:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185593984:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.952726:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788529807.952727:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185593600:0@lo:400:kworker.0 00000100:00100000:2.0:1788529807.952731:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185594368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788529807.952757:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529807.952800:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185594368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529807.952806:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788529807.953060:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc1880 x1875409185594368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529807.953085:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185594368:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788529807.953528:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529808.666699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529808.666733:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529808.666758:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529808.666877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290176 00000100:00100000:0.0:1788529808.666887:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290176 00000100:00100000:0.0:1788529808.666970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 258 00000100:00100000:0.0:1788529808.666979:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158290176:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529808.667076:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158290176:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529808.667083:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 258 00000100:00100000:3.0:1788529808.667325:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290432 00000100:00100000:3.0:1788529808.667330:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290432 00000100:00100000:3.0:1788529808.667378:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290304 00000100:00100000:3.0:1788529808.667381:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290304 00000100:00100000:3.0:1788529808.667405:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1788529808.667412:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158290432:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529808.667443:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158290432:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529808.667449:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1788529808.667462:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:3.0:1788529808.667468:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158290304:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529808.667486:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158290304:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 19us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529808.667491:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00080000:1.0:1788529808.667543:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529808.717758:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529809.755793:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529810.000078:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185594496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529810.000148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529810.000233:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594496 00000100:00100000:3.0:1788529810.000241:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594496 00000100:00100000:3.0:1788529810.000302:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788529810.000312:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185594496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529810.000345:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529810.000389:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185594496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529810.000397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788529810.000663:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc1880 x1875409185594496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529810.000682:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185594496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788529810.004376:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788529810.765289:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529811.795328:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529812.813266:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529813.069328:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529813.069359:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185594624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529813.069472:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529813.071436:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185595008:0@lo:400:kworker.0 00000100:00100000:2.0:1788529813.071522:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529813.071576:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529813.071584:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185595136:0@lo:400:kworker.0 00000100:00100000:2.0:1788529813.071627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529813.071675:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595136 00000100:00100000:2.0:1788529813.071683:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595136 00000100:00100000:2.0:1788529813.071769:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788529813.071786:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185595136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072041:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185594752:0@lo:400:kworker.0 00000100:00100000:3.0:1788529813.072042:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594624 00000100:00100000:3.0:1788529813.072046:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594624 00000100:00100000:1.0:1788529813.072077:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529813.072145:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185595264:0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072167:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529813.072186:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529813.072191:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185594880:0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072208:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788529813.072229:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529813.072251:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595008 00000100:00100000:1.0:1788529813.072254:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595008 00000100:00100000:1.0:1788529813.072286:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595264 00000100:00100000:1.0:1788529813.072289:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595264 00000100:00100000:1.0:1788529813.072301:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594880 00000100:00100000:1.0:1788529813.072304:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594880 00000100:00100000:1.0:1788529813.072317:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788529813.072323:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185595008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072352:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185595008:12345-0@lo:400:kworker.0 Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529813.072371:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788529813.072372:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788529813.072384:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185594624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529813.072387:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788529813.072392:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185595264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072420:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185595264:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529813.072426:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788529813.072435:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00002000:00000024:3.0:1788529813.072439:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529813.072440:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185594880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072463:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185594880:12345-0@lo:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529813.072468:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788529813.072487:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529813.072490:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529813.072502:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185594624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529813.072512:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788529813.072514:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185594880:0@lo:400:kworker.0 00000100:00100000:1.0:1788529813.072523:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185595264:0@lo:400:kworker.0 00000100:00100000:2.0:1788529813.072602:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185595136:12345-0@lo:400:kworker.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529813.072610:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788529813.072667:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185594752 00000100:00100000:0.0:1788529813.072671:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185594752 00010000:00080000:3.0:1788529813.072734:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3ca80 x1875409185595136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529813.072736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788529813.072743:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529813.072756:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185595136:0@lo:400:kworker.0 00000100:00100000:3.0:1788529813.072780:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185595008:0@lo:400:kworker.0 00010000:00080000:3.0:1788529813.072816:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc1880 x1875409185594624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529813.072844:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185594752:12345-0@lo:400:kworker.0 Request processed in 101us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529813.072850:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788529813.072862:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185594624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529813.073008:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185594752:0@lo:400:kworker.0 00000100:00100000:2.0:1788529813.799814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529813.799999:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529813.800045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529813.800691:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290816 00000100:00100000:3.0:1788529813.800718:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290816 00000100:00100000:3.0:1788529813.800812:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290688 00000100:00100000:3.0:1788529813.800816:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290688 00000100:00100000:3.0:1788529813.800843:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1788529813.800856:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158290816:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529813.801009:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158290816:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 155us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529813.801018:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1788529813.801041:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:3.0:1788529813.801049:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158290688:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529813.801077:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158290688:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529813.801083:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00080000:2.0:1788529813.804745:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529813.809077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290560 00000100:00100000:1.0:1788529813.809098:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290560 00000100:00100000:1.0:1788529813.809206:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 260 00000100:00100000:1.0:1788529813.809221:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158290560:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529813.809348:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158290560:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 129us (9548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529813.809356:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 260 00010000:00010000:2.0:1788529813.838110:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529814.861693:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529815.122031:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529815.122058:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185595392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529815.122138:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529815.127029:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595392 00000100:00100000:2.0:1788529815.127047:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595392 00000100:00100000:2.0:1788529815.127118:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788529815.127129:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185595392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788529815.127669:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529815.127767:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185595392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 640us (5629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529815.127775:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788529815.127802:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529815.128118:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcb20000 x1875409185595392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529815.128156:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185595392:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788529815.145811:0:11032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788529815.885307:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529816.909974:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529817.933096:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529818.189196:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185595776:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.189279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529818.189365:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595776 00000100:00100000:2.0:1788529818.189370:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529818.189375:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595776 00000100:00100000:2.0:1788529818.189407:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529818.189455:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788529818.189458:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529818.189469:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185595776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.189474:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185595904:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.189508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529818.189591:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185595520:0@lo:400:kworker.0 00000100:00100000:3.0:1788529818.191151:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185595776:12345-0@lo:400:kworker.0 Request processed in 1679us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529818.191166:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788529818.191227:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529818.191227:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185595776:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.191289:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596288 00000100:00100000:2.0:1788529818.191296:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596288 00000100:00100000:3.0:1788529818.191310:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595904 00000100:00100000:3.0:1788529818.191318:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595904 00000100:00100000:3.0:1788529818.192002:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788529818.192016:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185595904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529818.192103:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185595904:12345-0@lo:400:kworker.0 Request processed in 93us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529818.192111:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788529818.192145:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529818.192149:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529818.192172:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529818.192185:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185596288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788529818.192235:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788529818.192277:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3c700 x1875409185595904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529818.192289:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185596288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529818.192314:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788529818.192327:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185595904:0@lo:400:kworker.0 00010000:00080000:3.0:1788529818.192362:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc1880 x1875409185596288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529818.192382:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529818.192428:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185595648:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.192473:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529818.192620:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185596160:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.192644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529818.192685:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596160 00000100:00100000:2.0:1788529818.192690:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596160 00000100:00100000:2.0:1788529818.192728:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788529818.192735:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185596160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.192769:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185596160:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529818.192774:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788529818.192798:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3c380 x1875409185596160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529818.192879:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185596160:0@lo:400:kworker.0 00000100:00100000:3.0:1788529818.193068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595648 00000100:00100000:3.0:1788529818.193072:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595648 00000100:00100000:3.0:1788529818.193163:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788529818.193169:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529818.193201:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185595648:12345-0@lo:400:kworker.0 Request processed in 34us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529818.193206:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788529818.193227:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185595648:0@lo:400:kworker.0 00000100:00100000:0.0:1788529818.193835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529818.194278:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185595520 00000100:00100000:2.0:1788529818.194287:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185595520 00000100:00100000:2.0:1788529818.194370:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788529818.194374:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185596032:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.194392:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529818.194431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529818.194473:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596032 00000100:00100000:3.0:1788529818.194479:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596032 00000100:00100000:0.0:1788529818.194495:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185595520:0@lo:400:kworker.0 00000100:00100000:2.0:1788529818.194508:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185595520:12345-0@lo:400:kworker.0 Request processed in 120us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529818.194525:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788529818.194534:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788529818.194544:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185596032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529818.194594:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185596032:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529818.194599:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788529818.194997:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529818.195035:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185596032:0@lo:400:kworker.0 00000100:00100000:0.0:1788529818.903723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529818.903765:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529818.903789:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529818.903817:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291200 00000100:00100000:0.0:1788529818.903827:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291200 00000100:00100000:0.0:1788529818.903910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291072 00000100:00100000:0.0:1788529818.903915:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291072 00000100:00100000:0.0:1788529818.903942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1788529818.903951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158291200:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529818.904024:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158291200:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529818.904032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1788529818.904050:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:0.0:1788529818.904057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158291072:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529818.904081:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158291072:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529818.904087:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00080000:0.0:1788529818.904103:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529818.908449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158290944 00000100:00100000:1.0:1788529818.908467:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158290944 00000100:00100000:1.0:1788529818.908537:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 262 00000100:00100000:1.0:1788529818.908548:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158290944:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529818.908624:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158290944:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 77us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529818.908632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 262 00010000:00010000:1.0:1788529818.958014:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788529819.001085:0:11180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde81b1f30 20000000:00000080:3.0:1788529819.001103:0:11180:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabf5fcec00 uarg=0000000000000000 20000000:01000000:3.0:1788529819.001140:0:11180:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788529819.001146:0:11180:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788529819.001151:0:11180:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788529819.002457:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788529819.002621:0:11180:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788529819.013252:0:11180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788529819.013606:0:11180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013628:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013638:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013644:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013651:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013659:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013679:0:11180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013724:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013747:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 13 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.013762:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596416:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529819.013912:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.013921:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 22 pid: 5824 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.013930:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596544:0@lo:104: 00000100:00100000:1.0:1788529819.013994:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529819.014036:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.014044:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 22 pid: 5823 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.014053:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596672:0@lo:104: 00000100:00100000:1.0:1788529819.014074:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529819.014102:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.014120:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 22 pid: 5822 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.014128:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596800:0@lo:104: 00000100:00100000:3.0:1788529819.014129:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596544 00000100:00100000:3.0:1788529819.014135:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596544 00000100:00100000:1.0:1788529819.014148:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529819.014170:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.014178:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529819.014185:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596672 00000100:00100000:1.0:1788529819.014186:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596928:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529819.014187:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596672 00000100:00100000:3.0:1788529819.014198:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185596800 00000100:00100000:3.0:1788529819.014200:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185596800 00000100:00100000:1.0:1788529819.014208:0:11180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfccc2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529819.014212:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529819.014220:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:11180:x1875409185596544:12345-0@lo:104: 00010000:00010000:3.0:1788529819.014232:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014295:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788529819.014301:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:11180:x1875409185596544:12345-0@lo:104: Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.014321:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529819.014337:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529819.014342:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6082300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:11180:x1875409185596672:12345-0@lo:104: 00010000:00010000:3.0:1788529819.014350:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014395:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788529819.014400:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6082300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:11180:x1875409185596672:12345-0@lo:104: Request processed in 58us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.014407:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529819.014419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529819.014425:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:11180:x1875409185596800:12345-0@lo:104: 00010000:00010000:3.0:1788529819.014432:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014460:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788529819.014465:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:11180:x1875409185596800:12345-0@lo:104: Request processed in 41us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.014471:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788529819.014496:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788529819.014502:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014509:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529819.014512:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014522:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529819.014529:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529819.014535:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529819.014567:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014574:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529819.014591:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014598:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3000/0xaa46022e3f18b05d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014612:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529819.014615:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014620:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529819.014623:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014629:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529819.014636:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529819.014641:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529819.014653:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014659:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529819.014672:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014689:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3e00/0xaa46022e3f18b04f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014698:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529819.014701:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014707:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529819.014710:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014717:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529819.014723:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529819.014728:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529819.014741:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014748:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529819.014754:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014761:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7e00/0xaa46022e3f18b041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b048 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.014773:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529819.014779:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529819.014781:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529819.014788:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529819.014795:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529819.014805:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185597056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529819.014834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529819.014857:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185597312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529819.014913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529819.014935:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529819.014941:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185597184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529819.014960:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529819.014984:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597056 00000100:00100000:3.0:1788529819.014988:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597056 00010000:00010000:3.0:1788529819.015008:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 23 pid: 5824 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529819.015027:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597312 00000100:00100000:3.0:1788529819.015030:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597312 00010000:00010000:3.0:1788529819.015040:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 24 pid: 5822 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529819.015049:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597184 00000100:00100000:3.0:1788529819.015052:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597184 00010000:00010000:3.0:1788529819.015060:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 25 pid: 5823 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529819.015070:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529819.015075:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3302:x1875409185597056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529819.015085:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529819.015090:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 25 pid: 5824 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015105:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 25 pid: 5824 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015122:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529819.015153:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3302:x1875409185597056:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.015159:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529819.015177:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529819.015183:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3301:x1875409185597312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529819.015190:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529819.015194:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 24 pid: 5822 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015202:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 24 pid: 5822 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015210:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529819.015234:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3301:x1875409185597312:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.015239:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529819.015250:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529819.015256:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185597184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529819.015262:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529819.015266:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 23 pid: 5823 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015272:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 23 pid: 5823 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.015287:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529819.015307:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185597184:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529819.015312:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529819.015346:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185597056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529819.015373:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185597184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529819.015380:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185597312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529819.015474:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3600/0xaa46022e3f18b064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b05d expref: 22 pid: 5824 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.015487:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596544:0@lo:104: 00010000:00010000:1.0:1788529819.015497:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3c00/0xaa46022e3f18b056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b04f expref: 21 pid: 5823 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.015503:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596672:0@lo:104: 00010000:00010000:1.0:1788529819.015511:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61df600/0xaa46022e3f18b048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b041 expref: 20 pid: 5822 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529819.015518:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596800:0@lo:104: 00010000:00010000:2.0:1788529819.015777:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529819.020552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529819.020593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529819.020703:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596416:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529819.020716:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1875409185596928:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529819.020769:0:11180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529819.021448:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291328 00000100:00100000:2.0:1788529819.021456:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291328 00010000:00010000:2.0:1788529819.021577:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 14 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529819.021705:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291456 00000100:00100000:2.0:1788529819.021710:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291456 00010000:00010000:2.0:1788529819.021725:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 15 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529819.021760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1788529819.021771:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5075850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+15:2354:x1875409158291328:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529819.021786:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529819.021792:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 15 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.021807:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 15 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.021825:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18b080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d15 expref: 15 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.021840:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529819.021919:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5075850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158291328:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 149us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529819.021927:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1788529819.021971:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1788529819.021978:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:2354:x1875409158291456:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529819.021998:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529819.022003:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022012:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022022:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b03a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cd6 expref: 13 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022034:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022057:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022072:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022078:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022085:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022092:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022098:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529819.022102:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022120:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022131:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529819.022141:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529819.022171:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+12:2354:x1875409158291456:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 183us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529819.022179:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00010000:00010000:1.0:1788529819.023023:0:11180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.023035:0:11180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529819.023054:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18b09c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529819.983323:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529820.138114:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529820.138200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291584 00000100:00100000:1.0:1788529820.138210:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291584 00000100:00100000:1.0:1788529820.138267:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 263 00000100:00100000:1.0:1788529820.138279:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+12:5600:x1875409158291584:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529820.138297:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529820.138317:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d3f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529820.138345:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529820.138357:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529820.138367:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529820.138418:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291584:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529820.138437:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 263 00000100:00100000:0.0:1788529820.145129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529820.145619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291712 00000100:00100000:3.0:1788529820.145630:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291712 00000100:00100000:3.0:1788529820.145684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:3.0:1788529820.145695:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291712:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529820.146009:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291712:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 315us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529820.146017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:3.0:1788529820.150500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529820.150576:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291840 00000100:00100000:1.0:1788529820.150586:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291840 00000100:00100000:1.0:1788529820.150647:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 265 00000100:00100000:1.0:1788529820.150659:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291840:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529820.150928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291840:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 270us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529820.150936:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 265 00000100:00100000:0.0:1788529820.170514:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529820.171060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158291968 00000100:00100000:3.0:1788529820.171071:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158291968 00000100:00100000:3.0:1788529820.171145:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:3.0:1788529820.171156:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158291968:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529820.171173:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529820.171193:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d46 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529820.171240:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529820.171251:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529820.171261:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:3.0:1788529820.171321:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158291968:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 167us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529820.171328:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:3.0:1788529820.173682:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529820.173870:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292096 00000100:00100000:0.0:1788529820.173920:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292096 00000100:00100000:0.0:1788529820.173976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:0.0:1788529820.173986:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158292096:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529820.174302:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158292096:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 317us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529820.174309:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 267 00000100:00100000:2.0:1788529820.177335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529820.177393:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292224 00000100:00100000:0.0:1788529820.177403:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292224 00000100:00100000:0.0:1788529820.177458:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:0.0:1788529820.177530:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158292224:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788529820.177814:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158292224:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 346us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529820.177822:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:2.0:1788529820.243255:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185597440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529820.243325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529820.243397:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597440 00000100:00100000:2.0:1788529820.243404:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597440 00000100:00100000:2.0:1788529820.243456:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788529820.244166:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185597440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788529820.244206:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529820.244257:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185597440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 793us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529820.244265:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788529820.244292:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529820.244322:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfce2a300 x1875409185597440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529820.244339:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185597440:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788529821.005016:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788529821.005079:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac4efb800 from 7 10000000:01000000:2.0:1788529821.005085:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788529821.005142:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.005155:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.005167:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529821.005196:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.005277:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529821.005342:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788529821.005425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597568 00000100:00100000:3.0:1788529821.005434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597568 00000100:00100000:3.0:1788529821.005492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788529821.005502:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185597568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529821.005545:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529821.005567:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b0b1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.005605:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.005617:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.005636:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529821.005698:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529821.005712:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788529821.006126:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529821.006144:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.006154:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529821.006695:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00010000:00010000:1.0:1788529821.008909:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788529821.014536:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529821.015462:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788529821.015515:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:3.0:1788529821.015561:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:3.0:1788529821.015629:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:3.0:1788529821.015689:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:3.0:1788529821.017293:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:3.0:1788529821.017333:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:3.0:1788529821.017477:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.017555:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529821.018954:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529821.022030:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597696 00000100:00100000:2.0:1788529821.022146:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597696 00000100:00100000:2.0:1788529821.022336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788529821.022348:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.022734:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529821.022757:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788529821.022945:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.023032:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.023185:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529821.034510:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597824 00000100:00100000:3.0:1788529821.034528:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597824 00000100:00100000:3.0:1788529821.034591:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788529821.034603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.036616:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2008us (13432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529821.036639:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788529821.037431:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc530c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788529821.037480:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788529821.042227:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788529821.042329:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.042411:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529821.042492:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529821.044252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185597952 00000100:00100000:3.0:1788529821.044264:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185597952 00000100:00100000:3.0:1788529821.044360:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788529821.044371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.044620:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185597952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 251us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529821.044629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788529821.044728:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185597952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788529821.045249:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788529821.045304:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:1.0:1788529821.045349:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:1.0:1788529821.045382:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:1.0:1788529821.045413:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:1.0:1788529821.045453:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598080:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.045493:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529821.049847:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598080 00000100:00100000:2.0:1788529821.049878:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598080 00000100:00100000:2.0:1788529821.054133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788529821.054210:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185598080:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.054630:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185598080:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 476us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529821.054638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788529821.056002:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529821.056118:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598080:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788529821.056333:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:2.0:1788529821.056350:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788529821.067476:0:11236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000020:01000000:3.0:1788529821.068965:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788529821.068991:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529821.069002:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.069015:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529821.069033:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788529821.069036:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf402e800 from 7 10000000:01000000:3.0:1788529821.069039:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529821.069141:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.069151:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.069161:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529821.069186:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.069252:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529821.069298:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529821.069731:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598208 00000100:00100000:2.0:1788529821.069739:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598208 00000100:00100000:2.0:1788529821.069961:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788529821.069973:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185598208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529821.069987:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529821.070000:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b0bf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.070023:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.070033:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.070054:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100600, rc 0) 00000100:00100000:2.0:1788529821.070099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529821.072259:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529821.072284:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529821.072297:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788529821.072705:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:1.0:1788529821.073642:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529821.074040:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788529821.074160:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788529821.074212:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788529821.074251:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788529821.074283:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788529821.074351:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788529821.074360:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:1.0:1788529821.074435:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.074494:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529821.074536:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529821.074561:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598336 00000100:00100000:1.0:1788529821.074567:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598336 00000100:00100000:2.0:1788529821.076012:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788529821.076197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788529821.076209:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.076488:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529821.076496:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788529821.076544:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.076585:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.076627:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529821.076654:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529821.076666:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598464 00000100:00100000:1.0:1788529821.076670:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598464 00000100:00100000:1.0:1788529821.076689:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788529821.076695:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.078280:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1579us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529821.078291:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788529821.081995:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788529821.084572:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529821.084660:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.084736:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529821.084777:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529821.086931:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598592 00000100:00100000:3.0:1788529821.086945:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598592 00000100:00100000:3.0:1788529821.087003:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788529821.087014:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529821.087920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 906us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529821.087930:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788529821.096009:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788529821.096501:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788529821.096612:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788529821.096699:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788529821.096763:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788529821.098504:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:1.0:1788529821.098572:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598720:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.098768:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529821.098867:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529821.098951:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598720 00000100:00100000:1.0:1788529821.098959:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598720 00000100:00100000:1.0:1788529821.101391:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788529821.101429:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598720:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.101725:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598720:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 323us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529821.101743:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788529821.102211:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598720:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788529821.102366:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788529821.102381:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788529821.105422:0:11237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:1.0:1788529821.108981:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788529821.109003:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788529821.109015:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529821.109028:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529821.109040:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788529821.109106:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc80f0000 from 7 10000000:01000000:1.0:1788529821.109110:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788529821.109151:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529821.109160:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529821.109171:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529821.109199:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.109266:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529821.109308:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfccc2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529821.109378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598848 00000100:00100000:3.0:1788529821.109386:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598848 00000100:00100000:3.0:1788529821.109436:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788529821.109446:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185598848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529821.109459:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529821.109471:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b0cd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.109494:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.109504:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529821.109512:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529821.109598:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185598848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529821.109604:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788529821.113528:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529821.113556:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529821.113570:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529821.114176:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.114241:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529821.114286:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788529821.115150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185598976 00000100:00100000:1.0:1788529821.115160:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185598976 00000100:00100000:1.0:1788529821.115924:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788529821.115937:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185598976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529821.116245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185598976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529821.116260:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788529821.116356:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185598976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.116408:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185599104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.116451:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529821.118317:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788529821.126070:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599104 00000100:00100000:3.0:1788529821.126086:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599104 00000100:00100000:2.0:1788529821.126388:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788529821.126400:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185599104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529821.126663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185599104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (10212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529821.126681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788529821.126952:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185599104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529821.139060:0:11238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788529821.139272:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788529821.139285:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788529821.139298:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529821.139312:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529822.029690:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529823.053157:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529823.309316:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185599232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529823.309392:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529823.309610:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599232 00000100:00100000:3.0:1788529823.309619:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599232 00000100:00100000:3.0:1788529823.309691:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788529823.309710:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185599232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529823.309746:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529823.309790:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185599232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529823.309807:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788529823.309889:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788529823.309953:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc0000 x1875409185599232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529823.309972:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185599232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529823.311433:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185599616:0@lo:400:kworker.0 00000100:00100000:1.0:1788529823.311483:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529823.311513:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529823.311520:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185599744:0@lo:400:kworker.0 00000100:00100000:1.0:1788529823.311547:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529823.311678:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599744 00000100:00100000:3.0:1788529823.311686:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599744 00000100:00100000:3.0:1788529823.311748:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788529823.311757:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529823.311821:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185599744:12345-0@lo:400:kworker.0 Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529823.311829:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788529823.313534:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185599360:0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.313591:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529823.313629:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185599872:0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.313653:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529823.313676:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529823.313690:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185599488:0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.313713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529823.313744:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599616 00000100:00100000:0.0:1788529823.313751:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599616 00000100:00100000:0.0:1788529823.313793:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599872 00000100:00100000:0.0:1788529823.313808:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599872 00000100:00100000:0.0:1788529823.313824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599488 00000100:00100000:0.0:1788529823.313827:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599488 00000100:00100000:0.0:1788529823.313841:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788529823.313849:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185599616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.313914:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185599616:12345-0@lo:400:kworker.0 Request processed in 65us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529823.313921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788529823.313937:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788529823.313943:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185599872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.313975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185599872:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529823.313981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788529823.313995:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788529823.314000:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185599488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.314026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185599488:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529823.314032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788529823.314048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185599360 00000100:00100000:0.0:1788529823.314052:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185599360 00000100:00100000:0.0:1788529823.314073:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788529823.314079:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.314189:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185599360:12345-0@lo:400:kworker.0 Request processed in 110us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529823.314196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788529823.314277:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185599488:0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.314288:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185599360:0@lo:400:kworker.0 00000100:00100000:0.0:1788529823.314296:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185599872:0@lo:400:kworker.0 00000100:00080000:1.0:1788529823.315274:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529823.315280:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529823.315326:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf6081c00 x1875409185599744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529823.315339:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185599744:0@lo:400:kworker.0 00000100:00100000:1.0:1788529823.315351:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185599616:0@lo:400:kworker.0 00000100:00100000:2.0:1788529824.036574:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529824.036624:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529824.036660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529824.036695:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292480 00000100:00100000:2.0:1788529824.036704:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292480 00000100:00100000:2.0:1788529824.036775:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292608 00000100:00100000:2.0:1788529824.036778:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292608 00000100:00100000:2.0:1788529824.036817:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1788529824.036827:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158292480:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529824.036927:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158292480:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529824.036934:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1788529824.036952:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:2.0:1788529824.036959:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158292608:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529824.036983:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158292608:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529824.036989:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00080000:2.0:1788529824.037005:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529824.054047:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292352 00000100:00100000:3.0:1788529824.054063:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292352 00000100:00100000:3.0:1788529824.054139:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 283 00000100:00100000:3.0:1788529824.054150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158292352:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529824.054225:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158292352:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 77us (17600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529824.054232:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 283 00010000:00010000:1.0:1788529824.078084:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529824.544732:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788529825.104177:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529825.357303:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529825.357338:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185600000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529825.357426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529825.357625:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600000 00000100:00100000:0.0:1788529825.357633:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600000 00000100:00100000:0.0:1788529825.357712:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788529825.357724:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185600000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529825.357773:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529825.357830:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185600000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529825.357838:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788529825.357886:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60ca680 x1875409185600000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529825.357927:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185600000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788529825.357996:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788529826.132003:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529827.149142:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529828.177606:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529828.432519:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185600384:0@lo:400:kworker.0 00000100:00100000:0.0:1788529828.432605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529828.432673:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529828.432680:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185600512:0@lo:400:kworker.0 00000100:00100000:0.0:1788529828.432757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529828.432791:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600384 00000100:00100000:0.0:1788529828.432798:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600384 00000100:00100000:0.0:1788529828.432917:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788529828.432937:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185600384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529828.432993:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185600384:12345-0@lo:400:kworker.0 Request processed in 68us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529828.433000:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788529828.433021:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529828.433054:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185600384:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433348:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185600128:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433382:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529828.433408:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185600640:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529828.433450:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788529828.433456:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185600256:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433493:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529828.433508:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185600768:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529828.433554:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600128 00000100:00100000:1.0:1788529828.433558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600128 00000100:00100000:1.0:1788529828.433589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788529828.433596:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185600128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433631:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185600128:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529828.433638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788529828.433666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600640 00000100:00100000:1.0:1788529828.433669:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600640 00000100:00100000:1.0:1788529828.433691:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600256 00000100:00100000:1.0:1788529828.433694:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600256 00000100:00100000:1.0:1788529828.433722:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788529828.433729:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185600640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433758:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185600640:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529828.433764:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788529828.433774:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788529828.433789:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433828:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185600256:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529828.433834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788529828.433855:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600512 00000100:00100000:1.0:1788529828.433859:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600512 00000100:00100000:1.0:1788529828.433883:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600768 00000100:00100000:1.0:1788529828.433886:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600768 00000100:00100000:1.0:1788529828.433920:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788529828.433927:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185600512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.433967:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185600512:12345-0@lo:400:kworker.0 Request processed in 40us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529828.433973:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788529828.433985:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788529828.433991:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185600768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.434016:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185600768:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529828.434021:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788529828.434050:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185600256:0@lo:400:kworker.0 00010000:00080000:1.0:1788529828.434061:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60c9f80 x1875409185600768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529828.434070:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185600768:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.434077:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185600128:0@lo:400:kworker.0 00000100:00100000:1.0:1788529828.434085:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185600640:0@lo:400:kworker.0 00000100:00100000:0.0:1788529828.436964:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788529828.436997:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185600896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529828.437079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788529828.437142:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529828.437148:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529828.437151:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788529828.437190:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60cb800 x1875409185600512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529828.437204:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185600512:0@lo:400:kworker.0 00000100:00100000:3.0:1788529828.437336:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185600896 00000100:00100000:3.0:1788529828.437344:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185600896 00000100:00100000:3.0:1788529828.437396:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788529828.437406:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185600896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529828.437458:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529828.437513:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185600896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529828.437520:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788529828.440587:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc3480 x1875409185600896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529828.440615:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185600896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529829.160369:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529829.160419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529829.160520:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292736 00000100:00100000:0.0:1788529829.160531:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292736 00000100:00100000:0.0:1788529829.160595:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 285 00000100:00100000:0.0:1788529829.160605:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158292736:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529829.160677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158292736:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 73us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529829.160686:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 285 00000100:00100000:2.0:1788529829.164371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529829.175210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292864 00000100:00100000:1.0:1788529829.175227:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292864 00000100:00100000:1.0:1788529829.175444:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158292992 00000100:00100000:1.0:1788529829.175449:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158292992 00000100:00100000:1.0:1788529829.175496:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:1.0:1788529829.175506:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158292864:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529829.175588:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158292864:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 84us (15168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529829.175595:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:1.0:1788529829.175613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:1.0:1788529829.175619:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158292992:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529829.175644:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158292992:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (11282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529829.175649:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00080000:2.0:1788529829.177792:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529829.197494:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529830.221402:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529830.477324:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529830.477357:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529830.477454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529830.477569:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601024 00000100:00100000:0.0:1788529830.477579:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601024 00000100:00100000:0.0:1788529830.477655:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788529830.477668:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185601024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529830.477738:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529830.477793:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185601024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529830.477800:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788529830.477827:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788529830.477864:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfbc82d80 x1875409185601024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529830.477884:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185601024:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788529830.691739:0:11481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:50:28 (1788529828) === 00000100:00100000:0.0:1788529830.914518:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529830.914609:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529830.915012:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158293248 00000100:00100000:3.0:1788529830.915023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158293248 00000100:00100000:3.0:1788529830.915088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788529830.915098:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14b4f045-1109-44f4-a991-3ed448c68aea+6:9714:x1875409158293248:12345-192.168.201.52@tcp:700:mkdir.0 00000100:00100000:3.0:1788529830.915201:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14b4f045-1109-44f4-a991-3ed448c68aea+6:9714:x1875409158293248:12345-192.168.201.52@tcp:700:mkdir.0 Request processed in 104us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529830.915208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1788529830.915593:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158293120 00000100:00100000:1.0:1788529830.915598:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158293120 00000100:00100000:1.0:1788529830.915639:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1788529830.915647:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158293120:12345-192.168.201.52@tcp:41:mkdir.0 00000004:00000024:1.0:1788529830.915691:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788529830.915760:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158293120:12345-192.168.201.52@tcp:41:mkdir.0 Request processed in 113us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529830.915788:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1788529830.932582:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529830.936086:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158293504 00000100:00100000:0.0:1788529830.936108:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158293504 00000100:00100000:0.0:1788529830.936196:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1788529830.936205:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:9714:x1875409158293504:12345-192.168.201.52@tcp:36:mkdir.0 00010000:00010000:0.0:1788529830.936261:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529830.936306:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18af99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc1 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936331:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529830.936341:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529830.936677:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936704:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936713:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936738:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936745:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.936751:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529830.937811:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788529830.937824:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937834:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937842:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937848:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529830.937853:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937860:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937882:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529830.937884:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529830.937889:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.937922:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529830.937941:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e59a7117 reply state 00000000278e433d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529830.937949:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788529830.938046:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:9714:x1875409158293504:12345-192.168.201.52@tcp:36:mkdir.0 Request processed in 1839us (5471us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788529830.938054:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00010000:00010000:3.0:1788529830.941705:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941726:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941733:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941740:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529830.941745:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941753:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941844:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cabc5e09e00) 00010000:00010000:3.0:1788529830.941864:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529830.941870:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.941876:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b0e2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529830.955596:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529830.955824:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158293632 00000100:00100000:3.0:1788529830.955834:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158293632 00000100:00100000:3.0:1788529830.955924:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1788529830.955935:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:9715:x1875409158293632:12345-192.168.201.52@tcp:101:chmod.0 00010000:00010000:3.0:1788529830.955958:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529830.955980:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b0e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d4d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956049:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956064:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956075:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529830.956110:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529830.956114:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529830.956151:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956176:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b0e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d4d expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956207:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d4d expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.956216:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230900) 00010000:00010000:3.0:1788529830.956219:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529830.956223:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031400, rc 0) 00000100:00100000:3.0:1788529830.956294:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:9715:x1875409158293632:12345-192.168.201.52@tcp:101:chmod.0 Request processed in 360us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529830.956301:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1788529830.960350:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529830.960495:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158293888 00000100:00100000:0.0:1788529830.960506:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158293888 00000100:00100000:0.0:1788529830.960578:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1788529830.960590:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:9715:x1875409158293888:12345-192.168.201.52@tcp:36:chmod.0 00010000:00010000:0.0:1788529830.960645:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529830.960687:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b0f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d4d expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.960718:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230900) 00010000:00010000:0.0:1788529830.960730:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529830.960757:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.960798:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529830.960809:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529830.961150:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a73b10e8 reply state 0000000037f0be47 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529830.961159:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788529830.961168:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788529830.961257:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:9715:x1875409158293888:12345-192.168.201.52@tcp:36:chmod.0 Request processed in 668us (918us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788529830.961264:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00010000:00010000:3.0:1788529830.970954:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.970974:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.970983:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.970989:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529830.970995:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.971003:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.971021:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:3.0:1788529830.971024:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788529830.971040:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529830.971048:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b0f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529831.028826:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529831.031909:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158294016 00000100:00100000:3.0:1788529831.031923:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158294016 00000100:00100000:3.0:1788529831.031995:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1788529831.032007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:9716:x1875409158294016:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:3.0:1788529831.032035:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529831.032061:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d54 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032125:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032151:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032162:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529831.032198:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529831.032202:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529831.032239:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032264:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d54 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032279:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d54 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.032298:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230200) 00010000:00010000:3.0:1788529831.032300:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529831.032304:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030600, rc 0) 00000100:00100000:3.0:1788529831.032368:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:9716:x1875409158294016:12345-192.168.201.52@tcp:101:chown.0 Request processed in 364us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529831.032375:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00080000:3.0:1788529831.032397:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529831.054720:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.055381:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158294144 00000100:00100000:0.0:1788529831.055393:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158294144 00000100:00100000:0.0:1788529831.055447:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788529831.055457:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:9716:x1875409158294144:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:0.0:1788529831.055479:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529831.055503:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b10c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d5b expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055581:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055597:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055628:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055644:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055652:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055672:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055765:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055774:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055781:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529831.055812:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788529831.055816:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529831.055837:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055849:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055857:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055875:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.055882:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.061992:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062011:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062031:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230200) 00010000:00010000:0.0:1788529831.062034:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.062040:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062048:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062068:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062075:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062081:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062086:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.062089:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062105:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062113:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cabc5e09a00) 00010000:00010000:0.0:1788529831.062116:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.062119:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.062125:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b11a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.064354:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b10c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d5b expref: 10 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.064380:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d5b expref: 9 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.064391:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:0.0:1788529831.064394:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788529831.064397:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de200, rc 0) 00000100:00100000:0.0:1788529831.064485:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+9:9716:x1875409158294144:12345-192.168.201.52@tcp:101:chown.0 Request processed in 9027us (10349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529831.064494:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1788529831.079026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529831.079062:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158294400 00000100:00100000:3.0:1788529831.079072:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158294400 00000100:00100000:3.0:1788529831.079119:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1788529831.079129:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+9:9716:x1875409158294400:12345-192.168.201.52@tcp:36:chown.0 00010000:00010000:3.0:1788529831.079186:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529831.079210:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d5b expref: 9 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.079229:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:3.0:1788529831.079240:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529831.079264:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.079278:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.079287:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529831.179589:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a6946a7 reply state 000000000c330d27 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529831.179607:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788529831.179623:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788529831.179791:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+10:9716:x1875409158294400:12345-192.168.201.52@tcp:36:chown.0 Request processed in 100658us (100769us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788529831.179801:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000001:00080000:2.0:1788529831.180944:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788529831.180985:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1788529831.181121:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181145:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181154:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181161:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529831.181166:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181174:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181195:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc9230f00) 00010000:00010000:1.0:1788529831.181198:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788529831.181203:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.181210:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529831.228178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.229945:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158294528 00000100:00100000:0.0:1788529831.229960:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158294528 00000100:00100000:0.0:1788529831.230031:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1788529831.230042:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:9717:x1875409158294528:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:0.0:1788529831.230068:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529831.230089:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b12f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d62 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788529831.232798:0:7603:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2417us 00010000:00010000:3.0:1788529831.245041:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529831.264412:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264434:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264460:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264477:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264484:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264491:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264811:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264822:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264829:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529831.264852:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788529831.264856:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529831.264925:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264938:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264944:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264961:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264967:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529831.264971:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264979:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.264992:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230200) 00010000:00010000:1.0:1788529831.264995:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529831.265000:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265007:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265017:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265024:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265029:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265033:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529831.265035:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265051:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265060:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cabc3837900) 00010000:00010000:1.0:1788529831.265062:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529831.265065:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265071:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18b13d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265109:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b12f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d62 expref: 8 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265125:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d62 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.265145:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788529831.265147:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788529831.265149:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529831.265227:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:9717:x1875409158294528:12345-192.168.201.52@tcp:101:touch.500 Request processed in 35186us (37059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529831.265238:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1788529831.273824:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529831.274163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158294784 00000100:00100000:3.0:1788529831.274176:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158294784 00000100:00100000:3.0:1788529831.274241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1788529831.274253:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:9717:x1875409158294784:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:3.0:1788529831.274275:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529831.274303:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b14b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274568:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274584:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274595:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274650:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.274675:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788529831.275415:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788529831.275707:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275729:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275764:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275771:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275778:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275784:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529831.275788:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275795:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275806:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788529831.275809:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529831.275813:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275819:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030200/0xaa46022e3f18b152 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529831.275843:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e93e360 reply state 00000000e6b8a14c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529831.275852:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788529831.275889:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18b14b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d69 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275939:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d69 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.275947:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529831.275950:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529831.275952:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031000, rc 0) 00000100:00100000:3.0:1788529831.276057:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+10:9717:x1875409158294784:12345-192.168.201.52@tcp:101:touch.500 Request processed in 1806us (2243us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788529831.276066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1788529831.284712:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529831.284810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295040 00000100:00100000:2.0:1788529831.284821:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295040 00000100:00100000:2.0:1788529831.284880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1788529831.284916:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+10:9717:x1875409158295040:12345-192.168.201.52@tcp:36:touch.500 00010000:00010000:2.0:1788529831.284988:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529831.285019:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d69 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.285043:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:2.0:1788529831.285055:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529831.285109:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.285123:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.285263:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529831.285546:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d761c1 reply state 000000000e3290f8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529831.285555:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529831.285648:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+11:9717:x1875409158295040:12345-192.168.201.52@tcp:36:touch.500 Request processed in 757us (944us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788529831.285683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00010000:00010000:0.0:1788529831.286044:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286054:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286061:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286066:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.286071:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286078:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286089:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff8cabc9230800) 00010000:00010000:0.0:1788529831.286099:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.286104:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.286111:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529831.296184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529831.296265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295168 00000100:00100000:2.0:1788529831.296294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295168 00000100:00100000:2.0:1788529831.296355:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1788529831.296366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+10:9717:x1875409158295168:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:2.0:1788529831.296392:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529831.296416:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d70 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.296484:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d70 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.296499:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d70 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.296521:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:2.0:1788529831.296525:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788529831.296530:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100e00, rc 0) 00000100:00100000:2.0:1788529831.296603:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+11:9717:x1875409158295168:12345-192.168.201.52@tcp:101:touch.500 Request processed in 239us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529831.296611:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00010000:00010000:3.0:1788529831.297593:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297607:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297615:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297620:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529831.297625:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297647:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297671:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:3.0:1788529831.297674:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529831.297678:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.297684:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b16e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529831.304508:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529831.304605:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295296 00000100:00100000:1.0:1788529831.304617:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295296 00000100:00100000:1.0:1788529831.304678:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1788529831.304687:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158295296:12345-192.168.201.52@tcp:8:touch.500 00010000:00080000:1.0:1788529831.304741:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:1.0:1788529831.304778:0:6688:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18b17c 00002000:00100000:1.0:1788529831.304791:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14b4f045-1109-44f4-a991-3ed448c68aea/ffff8caac77ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788529831.304816:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788529831.305084:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788529831.305119:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8caac77ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788529831.305209:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158295296:12345-192.168.201.52@tcp:8:touch.500 Request processed in 519us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529831.305217:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1788529831.307730:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529831.307825:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295424 00000100:00100000:2.0:1788529831.307834:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295424 00000100:00080000:3.0:1788529831.307987:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529831.308110:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1788529831.308123:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:0:x1875409158295424:12345-192.168.201.52@tcp:2:touch.500 00000001:00080000:0.0:1788529831.395743:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788529831.395760:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000100:00100000:3.0:1788529831.396123:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:0:x1875409158295424:12345-192.168.201.52@tcp:2:touch.500 Request processed in 87997us (88396us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788529831.396135:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1788529831.401751:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.402173:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295680 00000100:00100000:0.0:1788529831.402187:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295680 00000100:00100000:0.0:1788529831.402265:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1788529831.402294:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+10:9717:x1875409158295680:12345-192.168.201.52@tcp:35:touch.500 00000100:00100000:0.0:1788529831.402715:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+11:9717:x1875409158295680:12345-192.168.201.52@tcp:35:touch.500 Request processed in 430us (972us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788529831.402723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1788529831.427026:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529831.427753:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158295808 00000100:00100000:2.0:1788529831.427776:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158295808 00000100:00100000:2.0:1788529831.427848:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1788529831.427860:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+11:9718:x1875409158295808:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1788529831.427917:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529831.427952:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d77 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.428023:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.428040:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.428053:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529831.428338:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529831.428342:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529831.428386:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.428417:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d77 expref: 13 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.428436:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d77 expref: 12 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.428445:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788529831.428448:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529831.428460:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101800, rc 0) 00000100:00100000:3.0:1788529831.428533:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+12:9718:x1875409158295808:12345-192.168.201.52@tcp:101:rm.0 Request processed in 667us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529831.428541:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1788529831.432967:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529831.433220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296064 00000100:00100000:2.0:1788529831.433231:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296064 00000100:00100000:2.0:1788529831.433303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1788529831.433315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+12:9718:x1875409158296064:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:2.0:1788529831.433338:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529831.433358:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18b191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d7e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529831.433458:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788529831.433639:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18b191 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d7e expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.433664:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230200) 00010000:00010000:2.0:1788529831.433668:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788529831.433674:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18b191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d7e expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529831.433689:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101400, rc 0) 00000100:00100000:2.0:1788529831.434490:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:9718:x1875409158296064:12345-192.168.201.52@tcp:101:rm.0 Request processed in 1174us (1529us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788529831.434499:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1788529831.443253:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.445688:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296192 00000100:00100000:0.0:1788529831.445704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296192 00000100:00100000:0.0:1788529831.445782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1788529831.445793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:9718:x1875409158296192:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:0.0:1788529831.451676:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:9718:x1875409158296192:12345-192.168.201.52@tcp:37:rm.0 Request processed in 5873us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529831.451691:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1788529831.461013:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529831.461178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296448 00000100:00100000:1.0:1788529831.461188:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296448 00000100:00100000:1.0:1788529831.461258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1788529831.461270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+13:9718:x1875409158296448:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:1.0:1788529831.461521:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:9718:x1875409158296448:12345-192.168.201.52@tcp:35:rm.0 Request processed in 252us (519us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788529831.461540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1788529831.464937:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.465033:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296704 00000100:00100000:0.0:1788529831.465044:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296704 00000100:00100000:0.0:1788529831.465102:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1788529831.465124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:9718:x1875409158296704:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1788529831.465156:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529831.465175:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.465269:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b1a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.465293:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.465306:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529831.465318:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788529831.465475:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d85 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.465493:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d85 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.465502:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788529831.465505:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788529831.465508:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529831.465572:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158296704:12345-192.168.201.52@tcp:101:rm.0 Request processed in 449us (683us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788529831.465579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1788529831.477110:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.477201:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296832 00000100:00100000:0.0:1788529831.477214:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296832 00000100:00100000:0.0:1788529831.477298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1788529831.477310:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158296832:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:0.0:1788529831.477387:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788529831.477465:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158296832:12345-192.168.201.52@tcp:41:rm.0 Request processed in 157us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529831.477473:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1788529831.480672:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.481020:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158296960 00000100:00100000:0.0:1788529831.481033:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158296960 00000100:00100000:0.0:1788529831.481096:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1788529831.481106:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158296960:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1788529831.481128:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529831.481150:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b1b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d8c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481214:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481231:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481243:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481260:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481267:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481274:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481386:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481394:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481401:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529831.481427:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788529831.481432:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529831.481448:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481459:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481467:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481474:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481479:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481485:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.481490:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481497:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481517:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788529831.481520:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.481534:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481542:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b1bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481557:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481564:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481570:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481575:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.481578:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481584:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481592:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff8cabc5e09000) 00010000:00010000:0.0:1788529831.481595:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.481597:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481603:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b1c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481646:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b1b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d8c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481674:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d8c expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.481681:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:0.0:1788529831.481684:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529831.481687:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de400, rc 0) 00000100:00100000:0.0:1788529831.481756:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+17:9718:x1875409158296960:12345-192.168.201.52@tcp:101:rm.0 Request processed in 650us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529831.481993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:3.0:1788529831.485173:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.485252:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158297216 00000100:00100000:0.0:1788529831.485262:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158297216 00000100:00100000:0.0:1788529831.485313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1788529831.485323:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+17:9718:x1875409158297216:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1788529831.485385:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788529831.485415:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b1c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d8c expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485441:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d70 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485453:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:0.0:1788529831.485470:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b18a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d77 expref: 15 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485500:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788529831.485504:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529831.485524:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485537:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485546:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485563:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485571:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485577:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485756:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485777:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.485785:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529831.486717:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788529831.486731:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341456836379ns, next at 342456832789ns, rc = 0 00010000:00010000:0.0:1788529831.487171:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487186:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487196:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487203:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487210:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487216:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487240:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529831.487260:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487267:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487274:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487279:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.487283:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487291:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487309:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc5e09600) 00010000:00010000:0.0:1788529831.487313:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788529831.487317:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487324:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487343:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487349:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.487354:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529831.487354:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487359:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529831.487360:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487361:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487368:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487375:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788529831.487377:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529831.487378:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529831.487380:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487381:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.487387:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.487388:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.487396:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cabc5e09600) 00010000:00010000:1.0:1788529831.487398:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788529831.487401:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529831.487406:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b1e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529831.487407:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f28d7dad reply state 000000001d506844 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529831.487415:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788529831.487420:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529831.487422:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529831.487423:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529831.487514:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158297216:12345-192.168.201.52@tcp:36:rm.0 Request processed in 2188us (2345us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788529831.487531:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00010000:00010000:0.0:1788529831.489601:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489618:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489626:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489632:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.489637:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489644:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489726:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff8cabc5e09a00) 00010000:00010000:0.0:1788529831.489731:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.489737:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.489743:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529831.498125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529831.498224:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158297472 00000100:00100000:1.0:1788529831.498234:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158297472 00000100:00100000:1.0:1788529831.498294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1788529831.498304:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+15:9718:x1875409158297472:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:1.0:1788529831.498541:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158297472:12345-192.168.201.52@tcp:35:rm.0 Request processed in 238us (424us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788529831.498549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1788529831.501992:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529831.502043:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158297728 00000100:00100000:0.0:1788529831.502054:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158297728 00000100:00100000:0.0:1788529831.502113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1788529831.502124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+16:9718:x1875409158297728:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1788529831.502185:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788529831.502213:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b1a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d85 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502240:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d62 expref: 15 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502251:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788529831.502280:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d54 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502290:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230200) 00010000:00010000:0.0:1788529831.502297:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529831.502319:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502331:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502340:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502352:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502376:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502383:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502633:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502642:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.502649:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529831.503309:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788529831.503325:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503334:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503341:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503347:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.503351:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503360:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503381:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cabc5e09100) 00010000:00010000:0.0:1788529831.503383:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788529831.503388:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503394:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18b1fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503414:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503421:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503427:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503433:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529831.503436:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503442:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503450:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09a00) 00010000:00010000:0.0:1788529831.503452:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529831.503455:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529831.503460:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de000/0xaa46022e3f18b1ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529831.503481:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e62b1c29 reply state 00000000f0d75e71 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529831.503490:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788529831.503575:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+15:9718:x1875409158297728:12345-192.168.201.52@tcp:36:rm.0 Request processed in 1450us (1591us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788529831.503583:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:3.0:1788529831.515517:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515545:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515555:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515562:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529831.515567:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515575:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515595:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cabc5e09000) 00010000:00010000:3.0:1788529831.515599:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529831.515604:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529831.515611:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18b1f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529832.269551:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529833.293245:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788529833.551676:0:7859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343521779085ns, next at 344521776052ns, rc = 0 00000100:00100000:3.0:1788529833.551717:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185601152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529833.551788:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529833.551864:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601152 00000100:00100000:3.0:1788529833.551873:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601152 00000100:00100000:3.0:1788529833.551950:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788529833.551960:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185601152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529833.551997:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529833.552046:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185601152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529833.552054:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788529833.552074:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788529833.552106:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfcbc2a00 x1875409185601152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529833.552124:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185601152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529833.556990:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185601280:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557068:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529833.557117:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529833.557123:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185601664:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557151:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529833.557202:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185601408:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557243:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529833.557265:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529833.557270:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185601536:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529833.557329:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601408 00000100:00100000:0.0:1788529833.557351:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601408 00000100:00100000:0.0:1788529833.557565:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601536 00000100:00100000:0.0:1788529833.557569:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601536 00000100:00100000:0.0:1788529833.557599:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788529833.557607:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185601408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557676:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185601408:12345-0@lo:400:kworker.0 Request processed in 69us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529833.557683:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788529833.557713:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788529833.557720:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185601536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557751:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185601536:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529833.557757:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788529833.557796:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185601536:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557805:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185601408:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.557937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601280 00000100:00100000:0.0:1788529833.557941:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601280 00000100:00100000:0.0:1788529833.557964:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788529833.557969:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185601280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.558002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185601280:12345-0@lo:400:kworker.0 Request processed in 32us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529833.558007:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788529833.558037:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185601280:0@lo:400:kworker.0 00000100:00100000:1.0:1788529833.559323:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529833.559358:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185601792:0@lo:400:kworker.0 00000100:00100000:1.0:1788529833.559445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529833.559493:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601792 00000100:00100000:1.0:1788529833.559500:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601792 00000100:00100000:1.0:1788529833.559549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788529833.559558:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185601792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529833.559607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185601792:12345-0@lo:400:kworker.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529833.559614:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788529833.559664:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185601792:0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.564993:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601664 00000100:00100000:0.0:1788529833.565010:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601664 00000100:00100000:0.0:1788529833.565090:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788529833.565102:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529833.565206:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185601664:12345-0@lo:400:kworker.0 Request processed in 106us (8053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529833.565214:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788529833.565247:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529833.565251:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788529833.565921:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5b2a300 x1875409185601664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529833.565940:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185601664:0@lo:400:kworker.0 00000100:00100000:1.0:1788529834.265287:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529834.265325:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529834.265381:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529834.265412:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529834.265445:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158297984 00000100:00100000:1.0:1788529834.265455:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158297984 00000100:00100000:1.0:1788529834.265513:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298240 00000100:00100000:1.0:1788529834.265516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298240 00000100:00100000:1.0:1788529834.265540:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:1.0:1788529834.265550:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:2355:x1875409158297984:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529834.265663:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:2355:x1875409158297984:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529834.265671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:1.0:1788529834.265689:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:1.0:1788529834.265696:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158298240:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529834.265722:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158298240:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529834.265740:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:2.0:1788529834.266078:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298112 00000100:00100000:2.0:1788529834.266083:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298112 00000100:00100000:2.0:1788529834.266129:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1788529834.266137:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158298112:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529834.266172:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158298112:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 36us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529834.266179:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1788529834.266406:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158297856 00000100:00100000:3.0:1788529834.266411:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158297856 00000100:00100000:3.0:1788529834.266478:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 287 00000100:00100000:3.0:1788529834.266485:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158297856:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529834.266515:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158297856:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 31us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529834.266528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 287 00000100:00080000:0.0:1788529834.266713:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529834.266718:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529834.317382:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529835.341238:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529835.597454:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529835.597479:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185601920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529835.597550:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529835.597845:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185601920 00000100:00100000:0.0:1788529835.597854:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185601920 00000100:00100000:0.0:1788529835.597941:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788529835.597952:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185601920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529835.597992:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529835.598043:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185601920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529835.598050:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788529835.598818:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529835.598855:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60ca680 x1875409185601920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529835.598875:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185601920:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788529836.250773:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788529836.250801:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788529836.250874:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788529836.251186:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529836.251219:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185602048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788529836.251319:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529836.251552:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602048 00000100:00100000:2.0:1788529836.251565:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602048 00000100:00080000:0.0:1788529836.251652:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529836.251676:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788529836.251689:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185602048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788529836.251725:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788529836.251792:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9acca7, atime: 0x6a9acca7, ctime: 0x6a9acca7, blocks: 0x1 00010000:00010000:2.0:1788529836.251801:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529836.251823:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1788529836.251828:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529836.251838:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529836.251858:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529836.251870:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529836.251881:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529836.251936:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529836.252087:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529836.252100:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529836.252117:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529836.252123:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529836.252138:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529836.252168:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529836.252190:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c201446/0xaa46022e3f18b201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529836.252220:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529836.252236:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529836.252238:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529836.252872:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185602048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1180us (1547us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788529836.252884:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788529836.252987:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabfc130380/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788529836.252998:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185602048:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788529836.367961:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529836.551704:0:11632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1788529836.694101:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1788529837.392183:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788529837.774183:0:11682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8de817f0 20000000:00000080:2.0:1788529837.774201:0:11682:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabc32a4000 uarg=0000000000000000 20000000:01000000:2.0:1788529837.774240:0:11682:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788529837.774247:0:11682:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788529837.774252:0:11682:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788529837.775853:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788529837.776149:0:11682:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788529837.781697:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788529837.781755:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788529837.782553:0:11682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788529837.782580:0:11682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788529837.782600:0:11682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782620:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782627:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782636:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782642:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782648:0:11682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782654:0:11682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782694:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.782711:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 22 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529837.782726:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3273480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602176:0@lo:104: 00000100:00100000:2.0:1788529837.784299:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788529837.784410:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.784422:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 22 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529837.784432:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602304:0@lo:104: 00000100:00100000:2.0:1788529837.784455:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788529837.786869:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.786910:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 22 pid: 5823 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529837.786927:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3271f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602432:0@lo:104: 00000100:00100000:2.0:1788529837.787032:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788529837.787285:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.787301:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 13 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529837.787311:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3273800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602560:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529837.787379:0:11682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529837.787388:0:11682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529837.787418:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3273b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602688:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529837.787442:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529837.792590:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602176 00000100:00100000:3.0:1788529837.792607:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602176 00000100:00100000:3.0:1788529837.792654:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602304 00000100:00100000:3.0:1788529837.792657:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602304 00000100:00100000:3.0:1788529837.792666:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602432 00000100:00100000:3.0:1788529837.792669:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602432 00000100:00100000:3.0:1788529837.792684:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529837.792693:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:11682:x1875409185602176:12345-0@lo:104: 00010000:00010000:3.0:1788529837.792721:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.792915:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788529837.792922:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+5:11682:x1875409185602176:12345-0@lo:104: Request processed in 231us (8628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.792930:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529837.792947:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529837.792953:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:11682:x1875409185602304:12345-0@lo:104: 00010000:00010000:3.0:1788529837.792962:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.792994:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788529837.792999:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+4:11682:x1875409185602304:12345-0@lo:104: Request processed in 46us (8542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.793021:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529837.793032:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529837.793038:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:11682:x1875409185602432:12345-0@lo:104: 00010000:00010000:3.0:1788529837.793046:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793077:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788529837.793082:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+3:11682:x1875409185602432:12345-0@lo:104: Request processed in 44us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.793087:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788529837.793102:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788529837.793108:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793115:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529837.793119:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793127:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529837.793134:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529837.793140:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529837.793185:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793193:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529837.793221:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793229:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18b0cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793241:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529837.793244:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793250:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529837.793253:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793260:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529837.793266:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529837.793271:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529837.793286:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793291:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529837.793298:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793304:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7c00/0xaa46022e3f18b0bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793313:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529837.793321:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793327:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529837.793330:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793337:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529837.793343:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529837.793940:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788529837.793963:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793969:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529837.793990:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.793996:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18b0b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18b0b8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.794011:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529837.794013:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529837.794014:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529837.794023:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529837.794028:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529837.794042:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185602816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529837.794087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529837.794138:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529837.794144:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185602944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529837.796093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529837.796674:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185603072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529837.798047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529837.798141:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602816 00000100:00100000:3.0:1788529837.798151:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602816 00010000:00010000:3.0:1788529837.798356:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 23 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.798396:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185602944 00000100:00100000:3.0:1788529837.798401:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185602944 00010000:00010000:3.0:1788529837.798416:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 24 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.798426:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603072 00000100:00100000:3.0:1788529837.798429:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603072 00010000:00010000:3.0:1788529837.798438:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 25 pid: 5823 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.798452:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529837.798461:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3302:x1875409185602816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529837.798476:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529837.798481:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 25 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.798495:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 25 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.798514:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529837.798578:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+25:3302:x1875409185602816:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (4489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.798585:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788529837.798603:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529837.798613:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3302:x1875409185602944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529837.798622:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529837.798628:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 24 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529837.798637:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 24 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529837.798651:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529837.798682:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3302:x1875409185602944:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.798688:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788529837.798694:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788529837.798695:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+24:3300:x1875409185603072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529837.798703:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529837.798717:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 23 pid: 5823 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.798732:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 23 pid: 5823 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.798742:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529837.798783:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185603072:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.798790:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788529837.798838:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185602944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529837.798849:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185602816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529837.798880:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:0.0:1788529837.798936:0:11682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7800/0xaa46022e3f18b0d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b0cd expref: 22 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.798939:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529837.798951:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3273480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602176:0@lo:104: 00000100:00100000:3.0:1788529837.798956:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298368 00000100:00100000:3.0:1788529837.798959:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298368 00010000:00010000:3.0:1788529837.798974:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 14 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.798990:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298496 00000100:00100000:3.0:1788529837.798992:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298496 00010000:00010000:0.0:1788529837.799000:0:11682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc5100600/0xaa46022e3f18b0c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b0bf expref: 21 pid: 5824 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799001:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 15 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529837.799009:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602304:0@lo:104: 00010000:00010000:0.0:1788529837.799018:0:11682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd6a00/0xaa46022e3f18b0b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18b0b1 expref: 20 pid: 5823 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.799022:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1788529837.799026:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3271f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602432:0@lo:104: 00000100:00100000:3.0:1788529837.799028:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+15:2355:x1875409158298368:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788529837.799034:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3273800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602560:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529837.799035:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529837.799039:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 15 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529837.799043:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3273b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11682:1875409185602688:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529837.799048:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 15 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799058:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7e00/0xaa46022e3f18b0aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d46 expref: 15 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799067:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529837.799069:0:11682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529837.799113:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158298368:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.799119:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1788529837.799132:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1788529837.799138:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:2355:x1875409158298496:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529837.799145:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529837.799150:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529837.799399:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185603072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529837.799441:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799452:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18b0a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d3f expref: 13 pid: 5823 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799470:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799479:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799493:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799500:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799507:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799512:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799519:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529837.799524:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.799531:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529837.803620:0:11682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529837.803640:0:11682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.804993:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.805013:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc5101800/0xaa46022e3f18b208 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529837.805047:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529837.805914:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:2355:x1875409158298496:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 6746us (6945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529837.805927:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00010000:00010000:3.0:1788529838.417413:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529838.669127:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529838.669271:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529838.669643:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603200 00000100:00100000:3.0:1788529838.669653:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603200 00000100:00100000:3.0:1788529838.670010:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788529838.670020:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185603200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529838.670055:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529838.670103:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185603200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529838.670109:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788529838.670255:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788529838.670262:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabfc130380, transno 4294967300 00000100:00100000:0.0:1788529838.670283:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529838.670323:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788529838.670343:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185603584:0@lo:400:kworker.0 00000100:00100000:0.0:1788529838.670380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529838.671112:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603584 00000100:00100000:0.0:1788529838.671119:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603584 00000100:00100000:3.0:1788529838.671219:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185603328:0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.671261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529838.671289:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185603840:0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.671312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529838.671334:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529838.671340:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185603456:0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.671361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529838.671392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603328 00000100:00100000:3.0:1788529838.671396:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603328 00000100:00100000:3.0:1788529838.671980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788529838.671992:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3302:x1875409185603328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.672040:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3302:x1875409185603328:12345-0@lo:400:kworker.0 Request processed in 52us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529838.672054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788529838.672086:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603840 00000100:00100000:3.0:1788529838.672091:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603840 00000100:00080000:2.0:1788529838.672944:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788529838.672954:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529838.673010:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185603712:0@lo:400:kworker.0 00000100:00100000:2.0:1788529838.673063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529838.673137:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185603328:0@lo:400:kworker.0 00000100:00100000:2.0:1788529838.673194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603456 00000100:00100000:2.0:1788529838.673199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603456 00000100:00100000:2.0:1788529838.673237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788529838.673244:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185603456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529838.673287:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185603456:12345-0@lo:400:kworker.0 Request processed in 44us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529838.673292:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788529838.673321:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185603456:0@lo:400:kworker.0 00000100:00100000:1.0:1788529838.673598:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603712 00000100:00100000:1.0:1788529838.673612:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603712 00000100:00100000:1.0:1788529838.673653:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788529838.673661:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185603712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529838.673701:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185603712:12345-0@lo:400:kworker.0 Request processed in 42us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529838.673707:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788529838.673724:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788529838.673744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc722d80 x1875409185603712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529838.673755:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185603712:0@lo:400:kworker.0 00000100:00100000:0.0:1788529838.676211:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788529838.676231:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185603584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.676688:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788529838.676921:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185603584:12345-0@lo:400:kworker.0 Request processed in 110us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529838.676963:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185603840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529838.677020:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185603840:12345-0@lo:400:kworker.0 Request processed in 61us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529838.677119:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185603840:0@lo:400:kworker.0 00000100:00100000:0.0:1788529838.677227:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788529838.677282:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788529838.677302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185603584:0@lo:400:kworker.0 00000100:00100000:3.0:1788529839.257309:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.257980:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298624 00000100:00100000:2.0:1788529839.257992:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298624 00000100:00100000:2.0:1788529839.258064:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 289 00000100:00100000:2.0:1788529839.258086:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+12:5600:x1875409158298624:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529839.258105:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529839.258130:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18b20f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.258198:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18b20f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d93 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.258210:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18b20f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d93 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.258219:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101400, rc 0) 00000100:00100000:2.0:1788529839.258294:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158298624:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 221us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.258301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 289 00000100:00100000:0.0:1788529839.261889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.262041:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298752 00000100:00100000:2.0:1788529839.262051:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298752 00000100:00100000:2.0:1788529839.262116:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 290 00000100:00100000:2.0:1788529839.262127:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158298752:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.262846:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158298752:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 717us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.262855:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 290 00000100:00100000:0.0:1788529839.270002:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529839.274694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158298880 00000100:00100000:3.0:1788529839.274718:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158298880 00000100:00100000:3.0:1788529839.275006:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 291 00000100:00100000:3.0:1788529839.275022:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158298880:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.280798:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158298880:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 5752us (10776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.280822:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 291 00000100:00100000:3.0:1788529839.302999:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529839.303694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299008 00000100:00100000:0.0:1788529839.303713:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299008 00000100:00100000:0.0:1788529839.303816:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 292 00000100:00100000:0.0:1788529839.303832:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:9989:x1875409158299008:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788529839.306088:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:9989:x1875409158299008:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 2245us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.306105:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 292 00000100:00100000:0.0:1788529839.313548:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.313713:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299136 00000100:00100000:2.0:1788529839.313726:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299136 00000100:00100000:2.0:1788529839.313798:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 293 00000100:00100000:2.0:1788529839.313810:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:9989:x1875409158299136:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788529839.314549:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:9989:x1875409158299136:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 739us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.314569:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 293 00000100:00100000:1.0:1788529839.327124:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529839.327422:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299264 00000100:00100000:0.0:1788529839.327440:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299264 00000100:00100000:0.0:1788529839.327536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 294 00000100:00100000:0.0:1788529839.327550:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+13:5600:x1875409158299264:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529839.327576:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529839.327601:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61df400/0xaa46022e3f18b216 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0d9a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.327658:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61df400/0xaa46022e3f18b216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d9a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.327672:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61df400/0xaa46022e3f18b216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d9a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.327684:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df400, rc 0) 00000100:00100000:0.0:1788529839.327765:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158299264:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 219us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.327773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 294 00000100:00100000:2.0:1788529839.335107:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529839.335612:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299392 00000100:00100000:0.0:1788529839.335627:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299392 00000100:00100000:0.0:1788529839.335704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 295 00000100:00100000:0.0:1788529839.335717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158299392:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.336169:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158299392:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 453us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.336185:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 295 00000100:00100000:1.0:1788529839.343239:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.343344:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299520 00000100:00100000:2.0:1788529839.343363:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299520 00000100:00100000:2.0:1788529839.343419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 296 00000100:00100000:2.0:1788529839.343429:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158299520:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.343739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:5600:x1875409158299520:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 310us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.343748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 296 00000100:00100000:1.0:1788529839.357861:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.359954:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299648 00000100:00100000:2.0:1788529839.359968:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299648 00000100:00100000:2.0:1788529839.360027:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 297 00000100:00100000:2.0:1788529839.360038:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:9992:x1875409158299648:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788529839.360373:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:9992:x1875409158299648:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 336us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.360382:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 297 00000100:00100000:0.0:1788529839.362820:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.362996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299776 00000100:00100000:2.0:1788529839.363006:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299776 00000100:00100000:2.0:1788529839.363059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 298 00000100:00100000:2.0:1788529839.363069:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:9992:x1875409158299776:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788529839.363334:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:9992:x1875409158299776:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 266us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.363342:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 298 00000100:00100000:1.0:1788529839.383675:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529839.383721:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529839.383754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529839.383770:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300032 00000100:00100000:2.0:1788529839.383792:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300032 00000100:00100000:2.0:1788529839.383861:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1788529839.383872:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158300032:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529839.383915:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158299904 00000100:00100000:0.0:1788529839.383919:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158299904 00000100:00100000:0.0:1788529839.383951:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300160 00000100:00100000:0.0:1788529839.383954:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300160 00000100:00100000:2.0:1788529839.383970:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158300032:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.383972:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:2.0:1788529839.383978:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1788529839.383979:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158299904:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529839.384010:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158299904:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.384026:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:0.0:1788529839.384039:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:0.0:1788529839.384045:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158300160:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529839.384071:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158300160:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.384077:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00080000:1.0:1788529839.384222:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529839.384228:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788529839.437125:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788529839.564998:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788529839.565005:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac4efb800 from 7 10000000:01000000:1.0:1788529839.565009:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788529839.565054:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529839.565065:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529839.565102:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529839.565195:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185603968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.565255:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529839.565309:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.565405:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185603968 00000100:00100000:0.0:1788529839.565413:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185603968 00000100:00100000:0.0:1788529839.565467:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788529839.565476:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+20:5827:x1875409185603968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529839.565489:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529839.565502:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b224 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b21d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.565535:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b21d expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.565546:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b21d expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.565554:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de000, rc 0) 00000100:00100000:0.0:1788529839.565593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185603968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.565597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788529839.565852:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185603968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529839.565865:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529839.565871:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788529839.566276:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000040:00080000:1.0:1788529839.570707:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788529839.572126:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788529839.572198:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788529839.572248:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788529839.572282:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788529839.572313:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788529839.572404:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788529839.572412:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:1.0:1788529839.572507:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.572588:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529839.572640:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529839.572851:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604096 00000100:00100000:2.0:1788529839.572858:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604096 00000100:00100000:2.0:1788529839.572945:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788529839.572955:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.573180:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.573189:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788529839.573766:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.573808:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.573858:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529839.574031:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529839.576649:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604224 00000100:00100000:2.0:1788529839.576666:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604224 00000100:00100000:2.0:1788529839.576822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788529839.576834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.578554:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1714us (4686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.578567:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788529839.578775:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788529839.579503:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788529839.579592:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604352:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.579650:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529839.579693:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529839.580301:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604352 00000100:00100000:2.0:1788529839.580309:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604352 00000100:00100000:2.0:1788529839.580363:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788529839.580373:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604352:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.581082:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604352:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 708us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.581100:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788529839.581686:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604352:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788529839.581974:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788529839.582028:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788529839.582088:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788529839.583290:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788529839.583334:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788529839.583757:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788529839.583807:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788529839.583839:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788529839.583890:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604480:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788529839.583989:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529839.584089:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.586917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604480 00000100:00100000:0.0:1788529839.586930:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604480 00000100:00100000:0.0:1788529839.586991:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788529839.587013:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604480:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.587257:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604480:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 245us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.587264:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788529839.587601:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604480:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788529839.587762:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788529839.587777:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788529839.592711:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529839.592724:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529839.592727:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788529839.592734:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8caac4efb800 00000020:00000080:1.0:1788529839.592736:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529839.592828:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529839.592831:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529839.592833:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788529839.592836:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788529839.594769:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788529839.594788:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529839.594799:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.594812:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529839.594831:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788529839.594834:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf402e800 from 7 10000000:01000000:3.0:1788529839.594837:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529839.594876:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.594931:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.594943:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529839.594971:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.595035:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.595078:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.596271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604608 00000100:00100000:0.0:1788529839.596280:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604608 00000100:00100000:0.0:1788529839.596337:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788529839.596348:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+21:5827:x1875409185604608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529839.596365:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529839.596380:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18b232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b22b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.596470:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18b232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b22b expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.596479:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18b232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b22b expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.596485:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de200, rc 0) 00000100:00100000:0.0:1788529839.596553:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.596560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788529839.596651:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529839.596669:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.596678:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529839.597325:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:3.0:1788529839.601663:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529839.603625:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788529839.603771:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:3.0:1788529839.603823:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:3.0:1788529839.603857:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:3.0:1788529839.603890:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:3.0:1788529839.604046:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:3.0:1788529839.604055:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:3.0:1788529839.604285:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.604365:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.604463:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448300 going to sleep for 11 seconds 00000100:00100000:2.0:1788529839.604966:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604736 00000100:00100000:2.0:1788529839.604977:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604736 00000100:00100000:2.0:1788529839.605035:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788529839.605045:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.605291:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.605312:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788529839.605729:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.605770:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.605811:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.605852:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448300 going to sleep for 11 seconds 00000100:00100000:2.0:1788529839.606239:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604864 00000100:00100000:2.0:1788529839.606245:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604864 00000100:00100000:2.0:1788529839.606280:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788529839.606287:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.606433:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529839.606440:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788529839.606528:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529839.611554:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788529839.611566:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788529839.613337:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604992:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.613436:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.613495:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185604992 00000100:00100000:3.0:1788529839.613502:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185604992 00000100:00100000:3.0:1788529839.613570:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788529839.613580:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604992:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.615304:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185604992:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 1716us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529839.615322:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788529839.615392:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529839.615420:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185604992:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788529839.616164:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788529839.616239:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:3.0:1788529839.616294:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:3.0:1788529839.616434:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:3.0:1788529839.616473:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:3.0:1788529839.616534:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:3.0:1788529839.616572:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:3.0:1788529839.616623:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:3.0:1788529839.616684:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605120:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.616777:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.616820:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.618559:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605120 00000100:00100000:0.0:1788529839.618575:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605120 00000100:00100000:0.0:1788529839.618627:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788529839.618636:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185605120:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.618913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185605120:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 277us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.618930:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788529839.619794:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605120:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788529839.619993:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788529839.620058:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788529839.621254:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529839.621265:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529839.621268:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788529839.621275:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cabf402e800 00000020:00000080:0.0:1788529839.621278:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788529839.621352:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529839.621356:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529839.621358:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788529839.621361:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:2.0:1788529839.623070:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788529839.623092:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788529839.623103:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.623124:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529839.623137:0:5827:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788529839.623139:0:5827:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc80f0000 from 7 10000000:01000000:2.0:1788529839.623148:0:5827:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788529839.623185:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.623193:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529839.623203:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529839.623227:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788529839.623292:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529839.623339:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23780 going to sleep for 11 seconds 00000100:00100000:3.0:1788529839.623552:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605248 00000100:00100000:3.0:1788529839.623560:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605248 00000100:00100000:3.0:1788529839.623619:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788529839.623630:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:5827:x1875409185605248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529839.623642:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529839.623656:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18b240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18b239 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.623679:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18b240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18b239 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.623688:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18b240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18b239 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.623697:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030200, rc 0) 00000100:00100000:3.0:1788529839.623748:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185605248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529839.623755:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788529839.623799:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529839.623813:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529839.623821:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529839.623869:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529839.623919:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529839.623935:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7448240 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.626230:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605376 00000100:00100000:0.0:1788529839.626243:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605376 00000100:00100000:0.0:1788529839.626291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788529839.626299:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185605376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.626601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185605376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.626609:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788529839.626666:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.626713:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.626760:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529839.626787:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605504 00000100:00100000:0.0:1788529839.626792:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605504 00000100:00100000:0.0:1788529839.626816:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788529839.626822:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185605504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.626990:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:5827:x1875409185605504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.627008:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788529839.627054:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.627068:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72cd2bce-e770-4df8-80b5-9001b91d336b:5827:1875409185605504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788529839.627374:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:11701:1875409185605632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529839.627459:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529839.627478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605632 00000100:00100000:0.0:1788529839.627481:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605632 00000100:00100000:0.0:1788529839.627501:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788529839.627507:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:11701:x1875409185605632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529839.627630:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:11701:x1875409185605632:12345-0@lo:502:llog_process_th.0 Request processed in 123us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.627636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788529839.627664:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.627676:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:11701:1875409185605632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788529839.627697:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529839.627705:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529839.627708:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788529839.627715:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cabc80f0000 00000020:00000080:0.0:1788529839.627717:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788529839.627772:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:11701:1875409185605760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529839.627798:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529839.627815:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605760 00000100:00100000:0.0:1788529839.627818:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605760 00000100:00100000:0.0:1788529839.627836:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788529839.627842:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:11701:x1875409185605760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529839.627971:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:11701:x1875409185605760:12345-0@lo:502:llog_process_th.0 Request processed in 128us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529839.627977:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788529839.628002:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788529839.628013:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72cd2bce-e770-4df8-80b5-9001b91d336b:11701:1875409185605760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788529839.628030:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529839.628034:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529839.628036:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788529839.628040:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788529839.628083:0:5827:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788529839.628091:0:5827:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788529839.628101:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529839.628871:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529840.461227:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529840.654021:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788529840.717304:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185605888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529840.717385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529840.717939:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185605888 00000100:00100000:1.0:1788529840.717949:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185605888 00000100:00100000:1.0:1788529840.718026:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788529840.718037:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185605888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529840.718073:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529840.718139:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185605888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529840.718146:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788529840.718188:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60caa00 x1875409185605888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529840.718205:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185605888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788529840.718324:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788529841.485183:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529842.509570:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529843.533110:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529843.789501:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185606144:0@lo:400:kworker.0 00000100:00100000:2.0:1788529843.789514:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185606016:0@lo:400:kworker.0 00000100:00100000:0.0:1788529843.789630:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185606272:0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.790294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529843.790391:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185606656:0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.790420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529843.790474:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185606400:0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.792076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529843.792123:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788529843.792134:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185606784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529843.792157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529843.792195:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606656 00000100:00100000:1.0:1788529843.792204:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606656 00000100:00100000:1.0:1788529843.792259:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606400 00000100:00100000:1.0:1788529843.792275:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606400 00000100:00100000:1.0:1788529843.792295:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788529843.792302:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185606656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.792352:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185606656:12345-0@lo:400:kworker.0 Request processed in 50us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529843.792359:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788529843.792374:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788529843.792380:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185606400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.792409:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185606400:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529843.792415:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788529843.792434:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606784 00000100:00100000:1.0:1788529843.792448:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606784 00000100:00100000:1.0:1788529843.792472:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788529843.792550:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185606784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529843.792579:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529843.792607:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185606784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529843.792612:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788529843.792628:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529843.792632:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529843.792668:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185606784:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788529843.792680:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac77cea00 x1875409185606400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529843.792689:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185606400:0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.792720:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185606656:0@lo:400:kworker.0 00000100:00100000:0.0:1788529843.793542:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529843.797188:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529843.797251:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606016 00000100:00100000:2.0:1788529843.797260:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606016 00000100:00100000:2.0:1788529843.797309:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788529843.797319:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185606016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529843.797380:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185606016:12345-0@lo:400:kworker.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529843.797388:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788529843.797797:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185606016:0@lo:400:kworker.0 00000100:00100000:2.0:1788529843.797808:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185606528:0@lo:400:kworker.0 00000100:00100000:2.0:1788529843.797840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529843.798795:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606144 00000100:00100000:3.0:1788529843.798803:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606144 00000100:00100000:1.0:1788529843.798809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606272 00000100:00100000:1.0:1788529843.798817:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606272 00000100:00100000:3.0:1788529843.798860:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788529843.798869:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185606144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.798882:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788529843.798912:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185606272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.798964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185606272:12345-0@lo:400:kworker.0 Request processed in 74us (5425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529843.798971:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788529843.799075:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529843.799105:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185606272:0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.799759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606528 00000100:00100000:1.0:1788529843.799764:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606528 00000100:00100000:1.0:1788529843.799806:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788529843.799813:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185606528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529843.799852:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185606528:12345-0@lo:400:kworker.0 Request processed in 39us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529843.799859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788529843.799924:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529843.799979:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185606528:0@lo:400:kworker.0 00000100:00100000:3.0:1788529843.800572:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185606144:12345-0@lo:400:kworker.0 Request processed in 1702us (10277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529843.800579:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788529843.800659:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185606144:0@lo:400:kworker.0 00000100:00100000:1.0:1788529844.514184:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529844.514234:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529844.514320:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300288 00000100:00100000:0.0:1788529844.514335:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300288 00000100:00100000:0.0:1788529844.514446:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 315 00000100:00100000:0.0:1788529844.514461:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158300288:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529844.514545:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158300288:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529844.514566:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 315 00000100:00100000:1.0:1788529844.514872:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529844.514962:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529844.515076:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300416 00000100:00100000:3.0:1788529844.515090:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300416 00000100:00100000:3.0:1788529844.515173:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300672 00000100:00100000:3.0:1788529844.515177:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300672 00000100:00100000:3.0:1788529844.515212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1788529844.515222:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158300416:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529844.515311:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158300416:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529844.515319:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1788529844.515351:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:3.0:1788529844.515357:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158300672:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529844.515590:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158300672:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 231us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529844.515604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00080000:1.0:1788529844.515935:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529844.517944:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300544 00000100:00100000:2.0:1788529844.517959:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300544 00000100:00100000:2.0:1788529844.518056:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1788529844.518067:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158300544:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529844.519010:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158300544:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529844.519020:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00080000:1.0:1788529844.520401:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788529844.557149:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529845.581195:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529845.837350:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529845.837383:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185606912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529845.837489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529845.838165:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185606912 00000100:00100000:3.0:1788529845.838177:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185606912 00000100:00100000:3.0:1788529845.838263:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788529845.838276:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185606912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529845.838322:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529845.838384:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185606912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529845.838392:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788529845.838511:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529845.839129:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf60ca680 x1875409185606912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529845.839159:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185606912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788529846.605755:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529847.629425:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529848.658432:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529848.909224:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185607040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529848.909334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529848.909614:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788529848.909652:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529848.909664:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185607168:0@lo:400:kworker.0 00000100:00100000:2.0:1788529848.909682:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529848.909693:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185607424:0@lo:400:kworker.0 00000100:00100000:1.0:1788529848.909716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529848.909733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529848.909757:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185607680:0@lo:400:kworker.0 00000100:00100000:1.0:1788529848.909798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529848.909799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607168 00000100:00100000:2.0:1788529848.909808:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607168 00000100:00100000:1.0:1788529848.909849:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529848.909856:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185607552:0@lo:400:kworker.0 00000100:00100000:2.0:1788529848.909874:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788529848.909887:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185607168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529848.909891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529848.909948:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607296 00000100:00100000:1.0:1788529848.909954:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607296 00000100:00100000:2.0:1788529848.909977:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185607168:12345-0@lo:400:kworker.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529848.909986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788529848.909994:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607424 00000100:00100000:1.0:1788529848.909999:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607424 00000100:00100000:1.0:1788529848.910029:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607680 00000100:00100000:1.0:1788529848.910033:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607680 00000100:00100000:1.0:1788529848.910054:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788529848.910062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788529848.910064:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529848.910074:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185607424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529848.910121:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185607296:12345-0@lo:400:kworker.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529848.910129:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788529848.910147:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788529848.910156:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185607680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529848.910163:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607040 00000100:00100000:3.0:1788529848.910170:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607040 00000100:00100000:1.0:1788529848.910187:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185607680:12345-0@lo:400:kworker.0 Request processed in 34us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529848.910196:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788529848.910214:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788529848.910222:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185607040:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788529848.910232:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788529848.910240:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1788529848.910258:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529848.910326:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185607168:0@lo:400:kworker.0 00000100:00100000:0.0:1788529848.910339:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185607680:0@lo:400:kworker.0 00000100:00100000:0.0:1788529848.910400:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607552 00000100:00100000:0.0:1788529848.910404:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607552 00000100:00100000:0.0:1788529848.910438:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788529848.910443:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185607552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529848.910479:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185607552:12345-0@lo:400:kworker.0 Request processed in 36us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529848.910484:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788529848.910514:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc3270a80 x1875409185607552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529848.910525:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185607552:0@lo:400:kworker.0 00000100:00080000:0.0:1788529848.910545:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529848.910670:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185607424:12345-0@lo:400:kworker.0 Request processed in 599us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529848.910677:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788529848.910809:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185607040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 588us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529848.910816:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788529848.912082:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185607424:0@lo:400:kworker.0 00000100:00100000:1.0:1788529848.912100:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185607296:0@lo:400:kworker.0 00000100:00100000:0.0:1788529848.912494:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185607040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529849.626728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529849.626852:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529849.635934:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529849.635985:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529849.636074:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300800 00000100:00100000:2.0:1788529849.636087:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300800 00000100:00100000:2.0:1788529849.636161:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 317 00000100:00100000:2.0:1788529849.636172:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158300800:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529849.636261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158300800:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529849.636269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 317 00000100:00100000:2.0:1788529849.636472:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301056 00000100:00100000:2.0:1788529849.636477:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301056 00000100:00100000:2.0:1788529849.636520:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:2.0:1788529849.636529:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158301056:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529849.636566:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158301056:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529849.636573:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00080000:2.0:1788529849.636776:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529849.640090:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158300928 00000100:00100000:1.0:1788529849.640112:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158300928 00000100:00100000:1.0:1788529849.640227:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301184 00000100:00100000:1.0:1788529849.640232:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301184 00000100:00100000:1.0:1788529849.640279:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:1.0:1788529849.640313:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158300928:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529849.640429:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158300928:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 118us (13718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529849.640438:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:1.0:1788529849.640471:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:1.0:1788529849.640479:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158301184:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529849.640506:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158301184:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (13655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529849.640513:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00080000:2.0:1788529849.641728:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529849.683661:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529850.701386:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788529850.894738:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788529850.960121:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788529850.960153:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185607808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529850.960257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529850.960465:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607808 00000100:00100000:0.0:1788529850.960476:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607808 00000100:00100000:0.0:1788529850.960576:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788529850.960586:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185607808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529850.960647:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529850.960706:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185607808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529850.960714:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788529850.960828:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529850.960865:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf6082a00 x1875409185607808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529850.960916:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185607808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788529851.726263:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529852.752935:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529853.773302:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529854.029415:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529854.029442:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185607936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529854.029516:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529854.030116:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185607936 00000100:00100000:0.0:1788529854.030125:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185607936 00000100:00100000:0.0:1788529854.030208:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788529854.030221:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185607936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529854.030271:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529854.030342:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185607936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529854.030349:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788529854.030401:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185607936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529854.031023:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185608448:0@lo:400:kworker.0 00000100:00100000:0.0:1788529854.031065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529854.031092:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529854.031098:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185608320:0@lo:400:kworker.0 00000100:00100000:0.0:1788529854.031123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529854.031152:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608448 00000100:00100000:0.0:1788529854.031158:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608448 00000100:00100000:0.0:1788529854.031192:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788529854.031200:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185608448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529854.031243:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185608448:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529854.031301:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788529854.031419:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185608192:0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529854.031471:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185608704:0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529854.031518:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788529854.031523:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185608064:0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529854.031581:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185608576:0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529854.031641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608320 00000100:00100000:3.0:1788529854.031645:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608320 00000100:00100000:3.0:1788529854.031685:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608192 00000100:00100000:3.0:1788529854.031689:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608192 00000100:00100000:3.0:1788529854.031703:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608576 00000100:00100000:3.0:1788529854.031705:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608576 00000100:00100000:3.0:1788529854.031721:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788529854.031727:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185608320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031761:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185608320:12345-0@lo:400:kworker.0 Request processed in 34us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529854.031767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788529854.031781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788529854.031787:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185608192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031818:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185608192:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529854.031832:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788529854.031846:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788529854.031852:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185608576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031880:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185608576:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529854.031886:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788529854.031942:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185608576:0@lo:400:kworker.0 00000100:00100000:3.0:1788529854.031953:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185608192:0@lo:400:kworker.0 00000100:00100000:2.0:1788529854.032370:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608704 00000100:00100000:2.0:1788529854.032375:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608704 00000100:00100000:2.0:1788529854.032412:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788529854.032420:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185608704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529854.032466:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185608704:12345-0@lo:400:kworker.0 Request processed in 47us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529854.032472:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788529854.032495:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608064 00000100:00100000:2.0:1788529854.032499:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608064 00000100:00100000:2.0:1788529854.032524:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788529854.032530:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185608064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529854.032571:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185608064:12345-0@lo:400:kworker.0 Request processed in 41us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529854.032577:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788529854.032629:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185608064:0@lo:400:kworker.0 00000100:00100000:2.0:1788529854.032640:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185608704:0@lo:400:kworker.0 00000100:00100000:0.0:1788529854.033135:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185608320:0@lo:400:kworker.0 00010000:00080000:0.0:1788529854.033150:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c1c00 x1875409185608448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529854.033161:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185608448:0@lo:400:kworker.0 00000100:00080000:1.0:1788529854.034432:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529854.034442:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529854.034445:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529854.752854:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529854.753031:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529854.755318:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301440 00000100:00100000:3.0:1788529854.755333:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301440 00000100:00100000:3.0:1788529854.755423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:3.0:1788529854.755433:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158301440:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529854.755510:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158301440:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 79us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529854.755517:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00080000:1.0:1788529854.755637:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529854.756761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301312 00000100:00100000:0.0:1788529854.756771:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301312 00000100:00100000:0.0:1788529854.756830:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 319 00000100:00100000:0.0:1788529854.756840:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158301312:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529854.757108:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158301312:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 269us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529854.757116:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 319 00000100:00100000:2.0:1788529854.762768:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529854.764197:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301568 00000100:00100000:0.0:1788529854.764212:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301568 00000100:00080000:1.0:1788529854.764497:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788529854.764762:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788529854.764774:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2353:x1875409158301568:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:0.0:1788529854.764807:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b17c 00000100:00080000:0.0:1788529854.764817:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8caac77ad000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788529854.764866:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788529854.766423:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529854.767078:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+2:2353:x1875409158301568:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 2300us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529854.767091:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1788529854.786706:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529854.787007:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301696 00000100:00100000:1.0:1788529854.787019:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301696 00000100:00100000:1.0:1788529854.787405:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:1.0:1788529854.787417:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158301696:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529854.787484:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158301696:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 70us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529854.787491:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00080000:2.0:1788529854.787528:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529854.797133:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529855.821140:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529856.079263:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185608832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529856.079361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529856.079979:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608832 00000100:00100000:0.0:1788529856.080008:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608832 00000100:00100000:0.0:1788529856.080084:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788529856.080093:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185608832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529856.080144:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529856.080200:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185608832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529856.080207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788529856.081062:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788529856.081114:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c1c00 x1875409185608832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529856.081139:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185608832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788529856.845539:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788529857.179105:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:3.0:1788529857.179114:0:7643:0:(genops.c:885:class_export_put()) final put ffff8caac77ae800/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:0.0:1788529857.179224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac77ae800/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-OST0001 00000020:00000080:0.0:1788529857.179356:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac77ad000 for lustre-OST0001 00010000:00010000:3.0:1788529857.869537:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529858.893020:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529859.161589:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185608960:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161732:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185609472:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161788:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529859.161794:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185609344:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161851:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185609088:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161891:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185609600:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161949:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788529859.161955:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185609216:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.161975:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.161992:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529859.162024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529859.162057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185608960 00000100:00100000:3.0:1788529859.162065:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185608960 00000100:00100000:3.0:1788529859.162122:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788529859.162132:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185608960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162195:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185608960:12345-0@lo:400:kworker.0 Request processed in 63us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162202:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788529859.162243:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609472 00000100:00100000:3.0:1788529859.162247:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609472 00000100:00100000:3.0:1788529859.162281:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609088 00000100:00100000:3.0:1788529859.162284:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609088 00000100:00100000:3.0:1788529859.162296:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609216 00000100:00100000:3.0:1788529859.162299:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609216 00000100:00100000:3.0:1788529859.162311:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788529859.162317:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185609472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162362:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185609472:12345-0@lo:400:kworker.0 Request processed in 45us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162369:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788529859.162381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788529859.162387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185609088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185609088:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162423:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788529859.162434:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788529859.162440:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185609216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162467:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185609216:12345-0@lo:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162473:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788529859.162489:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609344 00000100:00100000:3.0:1788529859.162492:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609344 00000100:00100000:3.0:1788529859.162517:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609600 00000100:00100000:3.0:1788529859.162520:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609600 00000100:00100000:3.0:1788529859.162534:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529859.162540:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185609344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162569:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185609344:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162580:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529859.162593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529859.162599:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185609600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162626:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185609600:12345-0@lo:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162632:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788529859.162659:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609728 00000100:00100000:3.0:1788529859.162663:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609728 00000100:00100000:3.0:1788529859.162685:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788529859.162692:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185609728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529859.162719:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529859.162752:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185609728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.162758:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788529859.162776:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529859.162780:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529859.162783:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529859.162819:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185609216:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162834:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529859.162843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185609088:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162851:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185609600:0@lo:400:kworker.0 00010000:00080000:3.0:1788529859.162889:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc3f71500 x1875409185609344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529859.162917:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185609344:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162933:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185608960:0@lo:400:kworker.0 00000100:00100000:3.0:1788529859.162941:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185609472:0@lo:400:kworker.0 00000100:00100000:1.0:1788529859.869988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529859.870027:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529859.870085:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529859.870197:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301952 00000100:00100000:3.0:1788529859.870208:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301952 00000100:00080000:1.0:1788529859.870270:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529859.870344:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158301824 00000100:00100000:0.0:1788529859.870349:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158301824 00000100:00100000:3.0:1788529859.870381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302080 00000100:00100000:0.0:1788529859.870383:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 321 00000100:00100000:3.0:1788529859.870385:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302080 00000100:00100000:0.0:1788529859.870392:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158301824:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529859.870410:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:3.0:1788529859.870416:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158301952:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529859.870473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:1.0:1788529859.870483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158302080:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529859.870541:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158301824:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 149us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529859.870547:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 321 00000100:00100000:3.0:1788529859.870981:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158301952:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 562us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529859.870988:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00080000:3.0:1788529859.871016:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529859.873713:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158302080:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 3221us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529859.873727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 151 00010000:00010000:3.0:1788529859.917062:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788529860.109637:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788529860.941151:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529861.198062:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788529861.198085:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185609856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529861.198181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529861.198548:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609856 00000100:00100000:3.0:1788529861.198558:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609856 00000100:00100000:3.0:1788529861.198636:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788529861.198646:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabd0f78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185609856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529861.198679:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529861.198733:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabd0f78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185609856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529861.198741:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788529861.199053:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c0380 x1875409185609856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529861.199072:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185609856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788529861.199224:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788529861.966486:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788529862.618199:0:11868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:51:00 (1788529860) 00010000:00010000:3.0:1788529862.993844:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529864.013189:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529864.271597:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529864.271736:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185610112:0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.271839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529864.271925:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529864.271932:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185610240:0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.271962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529864.272003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610112 00000100:00100000:3.0:1788529864.272012:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610112 00000100:00100000:3.0:1788529864.272070:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788529864.272091:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185610112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.272152:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185610112:12345-0@lo:400:kworker.0 Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.272174:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788529864.272210:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610240 00000100:00100000:3.0:1788529864.272214:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610240 00000100:00100000:3.0:1788529864.272249:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788529864.272257:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185610240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.272296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185610240:12345-0@lo:400:kworker.0 Request processed in 41us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.272302:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788529864.272366:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185610240:0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.272377:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185610112:0@lo:400:kworker.0 00000100:00100000:0.0:1788529864.272937:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529864.272953:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185610368:0@lo:400:kworker.0 00000100:00100000:0.0:1788529864.272994:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529864.275164:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610368 00000100:00100000:3.0:1788529864.275206:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610368 00000100:00100000:3.0:1788529864.275478:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788529864.275494:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185610368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.275868:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185610368:12345-0@lo:400:kworker.0 Request processed in 379us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.275877:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788529864.276008:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185610368:0@lo:400:kworker.0 00000100:00100000:1.0:1788529864.276382:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185609984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529864.276508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529864.278139:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185609984 00000100:00100000:3.0:1788529864.278157:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185609984 00000100:00100000:2.0:1788529864.280921:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529864.281100:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185610624:0@lo:400:kworker.0 00000100:00100000:1.0:1788529864.281211:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529864.281223:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185610496:0@lo:400:kworker.0 00000100:00100000:1.0:1788529864.281304:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529864.281357:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610496 00000100:00100000:1.0:1788529864.281367:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610496 00000100:00100000:2.0:1788529864.281445:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529864.281489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610624 00000100:00100000:2.0:1788529864.281492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610624 00000100:00080000:0.0:1788529864.282128:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529864.282136:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529864.282140:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529864.285021:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788529864.285047:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185610496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.285091:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788529864.285103:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185609984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529864.285144:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529864.285510:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788529864.285521:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185610624:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788529864.295675:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabc3272300 x1875409185610496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788529880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529864.295728:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185610496:0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.303469:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185609984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 18353us (26944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.303491:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788529864.303644:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185609984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529864.306926:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185610496:12345-0@lo:400:kworker.0 Request processed in 21875us (25605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529864.306946:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788529864.312495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185610624:12345-0@lo:400:kworker.0 Request processed in 26959us (31032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529864.312516:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788529864.312832:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185610624:0@lo:400:kworker.0 00000100:00100000:3.0:1788529864.956424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529864.956760:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302208 00000100:00100000:0.0:1788529864.956774:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302208 00000100:00100000:0.0:1788529864.956869:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1788529864.956882:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:10263:x1875409158302208:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529864.956945:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529864.956985:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b247 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0da1 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957080:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957097:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957113:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529864.957159:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788529864.957163:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529864.957214:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957243:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da1 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957266:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da1 expref: 6 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529864.957295:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:0.0:1788529864.957312:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788529864.957317:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de400, rc 0) 00000100:00100000:0.0:1788529864.957404:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:10263:x1875409158302208:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 524us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529864.957412:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00080000:2.0:1788529864.957751:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529864.964417:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529864.964532:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302336 00000100:00100000:3.0:1788529864.964546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302336 00000100:00100000:3.0:1788529864.964620:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:3.0:1788529864.964632:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:10264:x1875409158302336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529864.964661:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529864.964700:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0da8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964794:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964832:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964846:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964866:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964874:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.964881:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965223:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965233:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965240:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529864.965275:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529864.965287:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529864.965313:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965324:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965341:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965349:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965356:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529864.965361:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965369:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965384:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:3.0:1788529864.965387:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529864.965393:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965400:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18b25c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965416:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965422:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965428:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965433:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529864.965444:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965450:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965458:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cabc9230d00) 00010000:00010000:3.0:1788529864.965460:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529864.965463:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965469:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b263 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965506:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da8 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965521:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da8 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.965528:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc9230f00) 00010000:00010000:3.0:1788529864.965531:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529864.965533:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030c00, rc 0) 00000100:00100000:3.0:1788529864.965625:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:10264:x1875409158302336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 994us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.965633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1788529864.979931:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529864.980947:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302592 00000100:00100000:3.0:1788529864.980974:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302592 00000100:00100000:3.0:1788529864.981059:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:3.0:1788529864.981082:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:10264:x1875409158302592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529864.981131:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529864.981160:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b271 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0daf expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.981257:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.981276:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529864.981289:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.984614:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.984666:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.984684:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529864.985402:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529864.985450:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529864.985561:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302848 00000100:00100000:1.0:1788529864.985573:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302848 00000100:00100000:1.0:1788529864.985663:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:1.0:1788529864.985676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158302848:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529864.985778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2357:x1875409158302848:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529864.985796:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00080000:0.0:1788529864.986019:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788529864.986197:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101a00/0xaa46022e3f18b286 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986316:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101a00/0xaa46022e3f18b286 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986330:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101a00/0xaa46022e3f18b286 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529864.986352:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788529864.986584:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986594:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986602:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986611:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529864.986617:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986627:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986648:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc9230f00) 00010000:00010000:2.0:1788529864.986654:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788529864.986657:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302720 00010000:00010000:2.0:1788529864.986661:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986673:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b278 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529864.986677:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302720 00010000:00010000:2.0:1788529864.986690:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986698:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986718:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986723:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529864.986727:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986736:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.986746:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529864.986749:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529864.986753:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529864.986778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 323 00000100:00100000:3.0:1788529864.986791:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158302720:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529864.986878:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158302720:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 90us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529864.986886:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 323 00010000:00010000:2.0:1788529864.987867:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b27f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.988784:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b271 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0daf expref: 10 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.988811:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101a00/0xaa46022e3f18b286 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0daf expref: 9 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529864.988822:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:2.0:1788529864.988825:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529864.988829:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101a00, rc 0) 00000100:00100000:2.0:1788529864.988965:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+9:10264:x1875409158302592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 7894us (9084us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788529864.988989:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1788529865.000854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529865.005363:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158302976 00000100:00100000:3.0:1788529865.005385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158302976 00000100:00100000:3.0:1788529865.005543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1788529865.005557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:10264:x1875409158302976:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788529865.006454:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:10264:x1875409158302976:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 896us (5614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529865.006464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00010000:00010000:2.0:1788529865.038667:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788529865.234726:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788529866.063289:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529866.319609:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529866.319634:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185610752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529866.319719:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529866.319782:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185610752 00000100:00100000:0.0:1788529866.319789:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185610752 00000100:00100000:0.0:1788529866.319845:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788529866.319854:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185610752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529866.320117:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529866.320175:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185610752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529866.320182:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788529866.320206:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788529866.320269:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc8c1f80 x1875409185610752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788529882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529866.320301:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185610752:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788529866.975800:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1788529867.085655:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529867.566478:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529867.566570:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158303104 00000100:00100000:2.0:1788529867.566585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158303104 00000100:00100000:2.0:1788529867.566690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1788529867.566703:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:10307:x1875409158303104:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529867.566730:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529867.566759:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0db6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566853:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566871:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566886:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566950:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566958:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.566989:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567263:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567272:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567280:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567287:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529867.567292:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567301:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567316:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:2.0:1788529867.567320:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529867.567326:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567334:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567350:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567356:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567369:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567375:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529867.567378:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567384:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567393:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cabc8c54900) 00010000:00010000:2.0:1788529867.567396:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529867.567399:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567404:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b2a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567445:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b294 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0db6 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567457:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:2.0:1788529867.567459:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529867.567463:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0db6 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.567472:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101c00, rc 0) 00000100:00100000:2.0:1788529867.567560:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:10307:x1875409158303104:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 860us (1097us total) trans 0 rc 301/301 00000100:00100000:2.0:1788529867.567579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00080000:0.0:1788529867.568477:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529867.591947:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.592093:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158303360 00000100:00100000:3.0:1788529867.592108:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158303360 00000100:00100000:3.0:1788529867.592189:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1788529867.592204:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:10307:x1875409158303360:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:3.0:1788529867.592300:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529867.592338:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b24e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da1 expref: 8 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.592359:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc5e09700) 00010000:00010000:3.0:1788529867.592374:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529867.592947:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.592966:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.592978:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.592995:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.593003:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.593010:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529867.594985:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788529867.595016:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595039:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595047:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595054:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529867.595059:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595068:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595088:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230a00) 00010000:00010000:3.0:1788529867.595092:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529867.595098:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.595105:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529867.595138:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000783e19df reply state 000000009960ced6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529867.595149:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529867.595321:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+9:10307:x1875409158303360:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 3114us (3382us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788529867.595332:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00010000:00010000:3.0:1788529867.611420:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611468:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611478:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611485:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529867.611491:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611501:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611524:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cabc9230100) 00010000:00010000:3.0:1788529867.611528:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529867.611534:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.611542:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529867.689843:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.690672:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158303488 00000100:00100000:3.0:1788529867.690689:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158303488 00000100:00100000:3.0:1788529867.690760:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1788529867.690772:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:10315:x1875409158303488:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:3.0:1788529867.690805:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529867.690837:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dbd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691215:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691234:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691248:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529867.691297:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529867.691301:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529867.691349:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691381:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dbd expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691398:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dbd expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.691409:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:3.0:1788529867.691412:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529867.691416:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529867.691500:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:10315:x1875409158303488:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 730us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529867.691508:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:2.0:1788529867.744873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529867.745160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158303616 00000100:00100000:1.0:1788529867.745174:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158303616 00000100:00100000:1.0:1788529867.745293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1788529867.745305:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:10321:x1875409158303616:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529867.745333:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529867.745359:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b2c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745444:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745463:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745492:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745499:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745505:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745660:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745676:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529867.745718:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788529867.745722:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529867.745771:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745785:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745792:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745799:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745805:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529867.745810:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745817:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745830:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:1.0:1788529867.745838:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529867.745844:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745850:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745864:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745869:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745874:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745879:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529867.745881:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745886:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745949:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cabc3837d00) 00010000:00010000:1.0:1788529867.745952:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529867.745955:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.745961:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b2d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.746001:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b2c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dc4 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.746037:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dc4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.746045:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529867.746047:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788529867.746050:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49600, rc 0) 00000100:00100000:1.0:1788529867.746131:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+10:10321:x1875409158303616:12345-192.168.201.52@tcp:101:bash.0 Request processed in 828us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529867.746139:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1788529867.748531:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.748588:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158303872 00000100:00100000:3.0:1788529867.748600:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158303872 00000100:00100000:3.0:1788529867.748842:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1788529867.748855:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+10:10321:x1875409158303872:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529867.748884:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529867.748932:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749115:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749133:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749147:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749165:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749173:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.749179:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788529867.749832:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788529867.750080:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750092:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750102:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750160:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750170:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750177:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750185:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529867.750191:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750200:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750215:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529867.750218:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529867.750224:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750230:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b2e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529867.750246:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0719a3c reply state 00000000390b9cff transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529867.750256:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788529867.750296:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b2e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750326:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.750334:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529867.750337:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529867.750340:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529867.750430:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+13:10321:x1875409158303872:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1577us (1910us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788529867.750439:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1788529867.753394:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1788529867.753614:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.753630:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.753689:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.753696:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529867.753702:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529867.753760:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304000 00000100:00100000:1.0:1788529867.753773:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304000 00010000:00010000:3.0:1788529867.753799:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.753818:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230a00) 00010000:00010000:3.0:1788529867.753821:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529867.753828:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529867.753830:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1788529867.753840:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158304000:12345-192.168.201.52@tcp:8:bash.0 00010000:00010000:3.0:1788529867.753850:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b2ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788529867.753878:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:1.0:1788529867.755054:0:6688:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18b304 00002000:00100000:1.0:1788529867.755073:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14b4f045-1109-44f4-a991-3ed448c68aea/ffff8cabc61f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788529867.755087:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788529867.755513:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788529867.755555:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8caac77af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788529867.755644:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158304000:12345-192.168.201.52@tcp:8:bash.0 Request processed in 1803us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529867.755657:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1788529867.757677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529867.757756:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304128 00000100:00100000:1.0:1788529867.757783:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304128 00000100:00080000:0.0:1788529867.757852:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529867.757872:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1788529867.757884:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:0:x1875409158304128:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529867.758037:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529867.758070:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dd2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529867.758218:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788529867.758245:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1788529867.758251:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529867.758265:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.758290:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.758309:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529867.758395:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:0:x1875409158304128:12345-192.168.201.52@tcp:101:bash.0 Request processed in 513us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529867.758403:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1788529867.767661:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529867.767837:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304256 00000100:00100000:1.0:1788529867.767851:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304256 00000100:00100000:1.0:1788529867.768104:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1788529867.768289:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:10321:x1875409158304256:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529867.768316:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529867.768344:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dd9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.768524:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.768535:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529867.768540:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529867.768547:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.768598:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.768620:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529867.768706:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185610880:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529867.768827:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd009ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529867.772383:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185610880:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529867.772435:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.772464:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:1.0:1788529867.772543:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:10321:x1875409158304256:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4428us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529867.772554:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1788529867.776640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.776776:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304384 00000100:00100000:3.0:1788529867.776790:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304384 00010000:00010000:3.0:1788529867.776847:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529867.776969:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1788529867.776982:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5076850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158304384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529867.777003:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529867.777051:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.777074:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.777960:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c68a8a84/0xaa46022e3f18b30b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd2 expref: 8 pid: 6687 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.777989:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529867.777994:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529867.778006:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.778268:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529867.778586:0:8455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529867.778610:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8455:1875409185611008:192.168.201.52@tcp:105: 00000100:00100000:2.0:1788529867.778742:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcfc71540 going to sleep for 11 seconds 00000100:00100000:0.0:1788529867.782070:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.782124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304640 00000100:00100000:3.0:1788529867.782139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304640 00000100:00100000:3.0:1788529867.782220:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1788529867.782233:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+12:10321:x1875409158304640:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1788529867.782368:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3272300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8455:1875409185611008:192.168.201.52@tcp:105: 00010000:00010000:2.0:1788529867.782402:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529867.782702:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5076850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158304384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 5722us (6077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529867.782713:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1788529867.782726:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:10321:x1875409158304640:12345-192.168.201.52@tcp:35:bash.0 Request processed in 496us (676us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788529867.782733:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1788529867.896701:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.896863:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158304896 00000100:00100000:3.0:1788529867.896881:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158304896 00000100:00100000:3.0:1788529867.897041:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1788529867.897055:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:10331:x1875409158304896:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529867.897094:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529867.897126:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0de0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529867.897254:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788529867.897416:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b319 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0de0 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.897433:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:3.0:1788529867.897436:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529867.897443:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0de0 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.897520:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529867.897652:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:10331:x1875409158304896:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 599us (967us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788529867.897660:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:0.0:1788529867.917514:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.917564:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158305152 00000100:00100000:3.0:1788529867.917578:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158305152 00000100:00100000:3.0:1788529867.917646:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788529867.917660:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:10331:x1875409158305152:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529867.918056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+15:10331:x1875409158305152:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 397us (557us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788529867.918065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1788529867.989243:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529867.989518:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158305280 00000100:00100000:3.0:1788529867.989533:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158305280 00000100:00100000:3.0:1788529867.989608:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1788529867.989619:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+15:10337:x1875409158305280:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529867.989647:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529867.989671:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0de7 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989745:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989759:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989771:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529867.989810:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788529867.989831:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529867.989851:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989877:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0de7 expref: 17 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989935:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0de7 expref: 16 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529867.989946:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529867.989949:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529867.989954:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529867.990037:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+16:10337:x1875409158305280:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 419us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529867.990045:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1788529867.993210:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529867.993341:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158305536 00000100:00100000:1.0:1788529867.993353:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158305536 00000100:00100000:1.0:1788529867.993414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1788529867.993422:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+16:10337:x1875409158305536:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529867.993444:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529867.993618:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dee expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.993768:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b33c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.993786:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.993801:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529867.993812:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788529867.993988:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dee expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.994004:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dee expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529867.994012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:1.0:1788529867.994030:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529867.994035:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49800, rc 0) 00000100:00100000:1.0:1788529867.994119:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+18:10337:x1875409158305536:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 695us (923us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788529867.994149:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:0.0:1788529868.000077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529868.000138:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.000200:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158305792 00000100:00100000:3.0:1788529868.000215:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158305792 00000100:00100000:1.0:1788529868.000237:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158305920 00000100:00100000:1.0:1788529868.000243:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158305920 00000100:00100000:1.0:1788529868.000315:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1788529868.000327:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:2355:x1875409158305920:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529868.000349:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529868.000386:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b33c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dee expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.000412:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:1.0:1788529868.000418:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529868.000575:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1788529868.000585:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+18:10337:x1875409158305792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529868.000612:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529868.000633:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b34a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0df5 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.000768:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.000786:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.000822:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529868.000837:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788529868.000992:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+20:2355:x1875409158305920:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 666us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529868.001001:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00010000:00010000:3.0:1788529868.001044:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b34a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0df5 expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.001065:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0df5 expref: 19 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.001074:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529868.001077:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788529868.001080:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:3.0:1788529868.001215:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+19:10337:x1875409158305792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 529us (1054us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788529868.001221:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1788529868.008742:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529868.008933:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306048 00000100:00100000:1.0:1788529868.008947:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306048 00000100:00100000:1.0:1788529868.009027:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1788529868.009040:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158306048:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:1.0:1788529868.009102:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.009129:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.009139:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529868.009144:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529868.009169:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.009214:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.009234:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529868.009251:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875409185611136:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529868.009371:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd009ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529868.013152:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875409185611136:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529868.013195:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529868.014771:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529868.014984:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306176 00000100:00100000:2.0:1788529868.014995:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306176 00002000:00100000:2.0:1788529868.015077:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cabc881c380 x1875409158306176/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:564/0 lens 504/0 e 0 to 0 dl 1788529879 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788529868.015381:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc881c380 with x1875409158306176 ext(0->12) 00010000:00010000:2.0:1788529868.015392:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 8 pid: 6688 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.015416:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 8 pid: 6688 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788529868.015444:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabc881c380 00000100:00100000:2.0:1788529868.015524:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1788529868.015535:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158306176:12345-192.168.201.52@tcp:4:lfs.0 00000001:00100000:1.0:1788529868.032581:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000001:00080000:3.0:1788529868.083921:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788529868.086826:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158306176:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 71276us (72060us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788529868.086854:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:0.0:1788529868.086872:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cabc881c380 x1875409158306176/t4294967299(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:564/0 lens 504/448 e 0 to 0 dl 1788529879 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529868.086884:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc881c380 with x1875409158306176 ext(0->12) 00010000:00010000:0.0:1788529868.086931:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.086960:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529868.086969:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabc881c380 00000100:00100000:2.0:1788529868.092508:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529868.092622:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306304 00000100:00100000:1.0:1788529868.092637:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306304 00010000:00010000:1.0:1788529868.092724:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529868.092779:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:1.0:1788529868.092792:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158306304:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529868.092812:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788529868.092840:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788529868.092844:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788529867 00002000:00010000:1.0:1788529868.092865:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788529868 00002000:00010000:1.0:1788529868.092868:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788529867 00002000:00010000:1.0:1788529868.092870:0:5814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788529868.092879:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.092950:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.092989:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a371b9d4/0xaa46022e3f18b312 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dd9 expref: 7 pid: 6688 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.093027:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788529868.093033:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529868.093041:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.093053:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.093096:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529868.093163:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158306304:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 373us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529868.093171:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00010000:00010000:3.0:1788529868.093421:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093433:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093466:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093476:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093492:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093500:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529868.093505:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093516:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093529:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.093537:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b35f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.093599:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158306048:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 84562us (84872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529868.093608:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1788529868.096587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529868.096679:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306560 00000100:00100000:1.0:1788529868.096695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306560 00000100:00100000:1.0:1788529868.096773:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1788529868.096784:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:10337:x1875409158306560:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:1.0:1788529868.096885:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0df5 expref: 19 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788529868.097368:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788529868.097436:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788529868.100949:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788529868.101071:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.101093:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.101109:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.101150:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.101169:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 23 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529868.101184:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc881dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875409185611264:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529868.101290:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788529868.110079:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529868.110244:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc881dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875409185611264:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529868.110290:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.110976:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529868.111075:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306688 00000100:00100000:2.0:1788529868.111088:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306688 00010000:00010000:2.0:1788529868.111137:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 24 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529868.111189:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:2.0:1788529868.111200:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+24:2354:x1875409158306688:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529868.111216:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529868.111223:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 24 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111241:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 24 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111263:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b2f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dcb expref: 24 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111280:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:2.0:1788529868.111286:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111318:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111325:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.111353:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529868.111423:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+23:2354:x1875409158306688:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 224us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529868.111432:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00010000:00010000:3.0:1788529868.112125:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.112139:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788529868.112328:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788529868.112603:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788529868.112752:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185611392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788529868.112825:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529868.112868:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529868.112961:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185611392 00000100:00100000:0.0:1788529868.112974:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185611392 00000100:00100000:0.0:1788529868.113043:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529868.113052:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185611392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788529868.113171:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185611392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529868.113179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788529868.113386:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185611392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788529868.114182:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788529868.114254:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185611520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788529868.114296:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529868.114316:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506cb40 going to sleep for 11 seconds 00000100:00080000:2.0:1788529868.114389:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529868.114456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185611520 00000100:00100000:0.0:1788529868.114462:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185611520 00000100:00100000:0.0:1788529868.114537:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529868.114545:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185611520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788529868.120774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875409185611520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 6222us (6468us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788529868.120789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529868.120959:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185611520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788529868.121065:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788529868.121116:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121126:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121133:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121139:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.121143:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121159:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121176:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529868.121178:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788529868.121183:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.121189:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b366 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788529868.121419:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788529868.121623:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788529868.121637:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378091742160ns, next at 379091739069ns, rc = 0 00000001:00080000:3.0:1788529868.121644:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788529868.121677:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529868.121680:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788529868.121687:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b351 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0df5 expref: 27 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.121793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+26:10337:x1875409158306560:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 25010us (25220us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788529868.121802:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000020:00080000:3.0:1788529868.121806:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788529868.124376:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529868.124473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158306816 00000100:00100000:1.0:1788529868.124484:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158306816 00000100:00100000:1.0:1788529868.124544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1788529868.124555:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+26:10337:x1875409158306816:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529868.124577:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529868.124599:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b36d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0dfc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.124668:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b36d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dfc expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.124683:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b36d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dfc expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529868.124703:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:1.0:1788529868.124706:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788529868.124709:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:1.0:1788529868.124824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+27:10337:x1875409158306816:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 269us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529868.124831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1788529868.138390:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.138491:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158307072 00000100:00100000:3.0:1788529868.138502:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158307072 00000100:00100000:3.0:1788529868.138564:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788529868.138575:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+27:10337:x1875409158307072:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529868.138854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+28:10337:x1875409158307072:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 279us (475us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788529868.138863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788529868.240456:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529868.240561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158307328 00000100:00100000:0.0:1788529868.240571:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158307328 00000100:00100000:0.0:1788529868.240634:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1788529868.240645:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+28:10348:x1875409158307328:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529868.240671:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529868.240694:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e03 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529868.240785:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788529868.241021:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b374 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e03 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.241038:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529868.241041:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529868.241047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e03 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529868.241061:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00000100:00100000:0.0:1788529868.243133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+29:10348:x1875409158307328:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2476us (2673us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788529868.243146:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1788529868.255966:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.256131:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158307456 00000100:00100000:3.0:1788529868.256142:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158307456 00000100:00100000:3.0:1788529868.256203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1788529868.256215:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+29:10348:x1875409158307456:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1788529868.256294:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256312:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256324:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256339:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256347:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256354:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256441:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256450:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256474:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529868.256514:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256526:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256533:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256540:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256546:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.256550:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256557:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256568:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529868.256571:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.256576:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256581:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256594:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256606:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256612:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256616:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.256620:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256638:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256647:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230b00) 00010000:00010000:3.0:1788529868.256650:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.256653:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256660:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256675:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256682:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256688:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256693:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.256701:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256708:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256716:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.256719:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.256722:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.256728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.256798:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+29:10348:x1875409158307456:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 585us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529868.256806:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1788529868.260519:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.260599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158307712 00000100:00100000:3.0:1788529868.260610:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158307712 00000100:00100000:3.0:1788529868.260682:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788529868.260693:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+29:10348:x1875409158307712:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529868.260985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+30:10348:x1875409158307712:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 293us (476us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788529868.260993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1788529868.335581:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.335684:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158307968 00000100:00100000:3.0:1788529868.335694:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158307968 00000100:00100000:3.0:1788529868.335751:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1788529868.335761:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+30:10351:x1875409158307968:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529868.335785:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529868.335819:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e0a expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335929:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335944:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335955:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335969:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335976:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.335983:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336112:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336120:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336127:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529868.336136:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788529868.336232:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336264:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336271:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336277:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.336281:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336289:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336300:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529868.336303:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.336309:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336315:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b39e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336331:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336337:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336344:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336349:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.336358:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336365:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336373:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230b00) 00010000:00010000:3.0:1788529868.336375:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.336378:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336383:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336426:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 33 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336440:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 32 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.336447:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.336449:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529868.336452:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:3.0:1788529868.336521:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+32:10351:x1875409158307968:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 761us (950us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788529868.336529:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:1.0:1788529868.343097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.343199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158308096 00000100:00100000:3.0:1788529868.343211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158308096 00000100:00100000:3.0:1788529868.343286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1788529868.343298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+32:10351:x1875409158308096:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1788529868.343393:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343413:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343426:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343454:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343461:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343468:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343475:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.343480:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343488:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343500:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.343504:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529868.343509:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.343516:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.343682:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+32:10351:x1875409158308096:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 386us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529868.343690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1788529868.347590:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.348108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158308352 00000100:00100000:3.0:1788529868.348121:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158308352 00000100:00100000:3.0:1788529868.348227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1788529868.348249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+32:10351:x1875409158308352:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529868.348494:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+33:10351:x1875409158308352:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 256us (913us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788529868.348502:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1788529868.732618:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.737916:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158308608 00000100:00100000:3.0:1788529868.737937:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158308608 00000100:00100000:3.0:1788529868.738015:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1788529868.738027:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+33:10382:x1875409158308608:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:3.0:1788529868.738052:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529868.738074:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e11 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.738183:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.738199:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.738210:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529868.738573:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788529868.739879:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e11 expref: 36 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.739922:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e11 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.739932:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.739934:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529868.739939:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529868.740037:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+35:10382:x1875409158308608:12345-192.168.201.52@tcp:101:cat.0 Request processed in 2010us (7426us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788529868.740046:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1788529868.748445:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.748525:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158308736 00000100:00100000:3.0:1788529868.748536:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158308736 00000100:00100000:3.0:1788529868.748608:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1788529868.748620:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+35:2355:x1875409158308736:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529868.748647:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529868.748673:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e11 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.748692:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.748699:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529868.748882:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+34:2355:x1875409158308736:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 264us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529868.748891:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1788529868.761035:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529868.761587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158308992 00000100:00100000:0.0:1788529868.761598:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158308992 00000100:00100000:0.0:1788529868.761668:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788529868.761677:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:10382:x1875409158308992:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:0.0:1788529868.762637:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:10382:x1875409158308992:12345-192.168.201.52@tcp:35:cat.0 Request processed in 954us (1635us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788529868.762645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788529868.867717:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529868.867810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158309248 00000100:00100000:3.0:1788529868.867820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158309248 00000100:00100000:3.0:1788529868.867891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1788529868.867931:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+35:10388:x1875409158309248:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:3.0:1788529868.867956:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529868.867959:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788529868.867985:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b32e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0de7 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868039:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529868.868045:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529868.868059:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e18 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868171:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868185:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868194:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868227:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.868256:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 35 pid: 7603 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529868.868292:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f72680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185611648:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529868.868394:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529868.872578:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f72680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185611648:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529868.872606:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529868.873536:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529868.874353:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158309376 00000100:00100000:2.0:1788529868.874366:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158309376 00010000:00010000:2.0:1788529868.874406:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 36 pid: 7603 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529868.874445:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1788529868.874454:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+36:2354:x1875409158309376:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529868.874467:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529868.874473:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 36 pid: 7603 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874489:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 36 pid: 7603 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874522:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b3ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e0a expref: 36 pid: 7603 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874537:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529868.874543:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874552:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874559:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.874588:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529868.874646:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:2354:x1875409158309376:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 192us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529868.874653:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00010000:00010000:3.0:1788529868.874779:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.874788:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529868.874805:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788529868.874994:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b3d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.875020:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.875028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.875031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529868.875033:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529868.875063:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+35:10388:x1875409158309248:12345-192.168.201.52@tcp:101:dd.0 Request processed in 7135us (7366us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788529868.875070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:0.0:1788529868.884492:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529868.884590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158309632 00000100:00100000:2.0:1788529868.884601:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158309632 00000100:00100000:2.0:1788529868.884672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1788529868.884682:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:10388:x1875409158309632:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:2.0:1788529868.885248:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.885266:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529868.885277:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529868.885339:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788529868.885362:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dcfe2cf reply state 00000000b2e760af transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529868.885370:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529868.885463:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+38:10388:x1875409158309632:12345-192.168.201.52@tcp:36:dd.0 Request processed in 782us (980us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788529868.885471:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000020:00080000:2.0:1788529868.885475:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529868.888407:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888426:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888434:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888457:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529868.888462:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888470:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888487:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529868.888490:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529868.888496:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529868.888503:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b3eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.133164:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529869.344024:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529869.344138:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158309760 00000100:00100000:1.0:1788529869.344158:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158309760 00000100:00100000:1.0:1788529869.344393:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1788529869.344407:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+37:10402:x1875409158309760:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1788529869.344435:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529869.344458:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b3f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e1f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344536:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344551:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344562:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344578:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344585:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344592:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.344718:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788529869.344833:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529869.345845:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.345858:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.345917:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.345936:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 38 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529869.345951:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185611776:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529869.346067:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2885180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529869.359581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529869.360222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158310016 00000100:00100000:3.0:1788529869.360232:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158310016 00000100:00100000:3.0:1788529869.360289:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1788529869.360299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+39:5598:x1875409158310016:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788529869.360662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:5598:x1875409158310016:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 364us (1088us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788529869.360671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1788529869.361766:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185611776:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529869.361795:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529869.365721:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529869.365869:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158310144 00000100:00100000:3.0:1788529869.365883:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158310144 00010000:00010000:3.0:1788529869.365977:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 40 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529869.366054:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1788529869.366093:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:2356:x1875409158310144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529869.366118:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529869.366127:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 40 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366149:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 40 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366179:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b3dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e18 expref: 40 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366205:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529869.366213:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366227:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366237:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.366276:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529869.366354:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+39:2356:x1875409158310144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 266us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529869.366364:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00010000:00010000:1.0:1788529869.366676:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.366695:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529869.366762:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788529869.366793:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529869.367111:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367232:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367248:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367256:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367263:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367271:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529869.367276:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367286:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367304:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529869.367308:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529869.367313:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367320:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b3f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367339:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367355:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367361:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367366:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529869.367370:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367377:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367385:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc3837f00) 00010000:00010000:1.0:1788529869.367388:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529869.367391:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367396:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367440:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b3f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e1f expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.367456:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e1f expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.368910:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:1.0:1788529869.368918:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529869.368942:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48400, rc 0) 00000100:00100000:1.0:1788529869.369065:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+38:10402:x1875409158309760:12345-192.168.201.52@tcp:101:stat.0 Request processed in 24655us (25045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529869.369079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1788529869.389668:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185612160:0@lo:400:kworker.0 00000100:00100000:1.0:1788529869.389777:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529869.389833:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529869.389841:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185612288:0@lo:400:kworker.0 00000100:00100000:1.0:1788529869.389869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529869.389930:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612288 00000100:00100000:1.0:1788529869.389938:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612288 00000100:00100000:1.0:1788529869.389988:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788529869.390009:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529869.390063:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185612288:12345-0@lo:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529869.390071:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788529869.390118:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185612288:0@lo:400:kworker.0 00000100:00100000:1.0:1788529869.390153:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612160 00000100:00100000:1.0:1788529869.390158:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612160 00000100:00100000:1.0:1788529869.390193:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788529869.390199:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185612160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529869.390234:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185612160:12345-0@lo:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529869.390240:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788529869.390255:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529869.390273:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185612160:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.390981:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185612032:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529869.391062:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185612544:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529869.391107:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788529869.391113:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185611904:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529869.391175:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185612416:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529869.391224:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612032 00000100:00100000:2.0:1788529869.391230:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612032 00000100:00100000:2.0:1788529869.391259:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612416 00000100:00100000:2.0:1788529869.391262:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612416 00000100:00100000:2.0:1788529869.391283:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788529869.391289:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185612032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391345:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185612032:12345-0@lo:400:kworker.0 Request processed in 54us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529869.391350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788529869.391365:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788529869.391371:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185612416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391396:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185612416:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529869.391401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788529869.391415:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529869.391434:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185612416:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391443:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185612032:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391463:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612544 00000100:00100000:2.0:1788529869.391466:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612544 00000100:00100000:2.0:1788529869.391493:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788529869.391499:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185612544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.391532:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185612544:12345-0@lo:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529869.391538:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788529869.391550:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529869.391566:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185612544:0@lo:400:kworker.0 00000100:00100000:0.0:1788529869.394616:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185611904 00000100:00100000:0.0:1788529869.394641:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185611904 00000100:00100000:0.0:1788529869.394743:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788529869.394756:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185611904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529869.394944:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185611904:12345-0@lo:400:kworker.0 Request processed in 191us (3803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529869.394954:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788529869.395601:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185611904:0@lo:400:kworker.0 00000100:00100000:2.0:1788529869.399621:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529869.399657:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc881ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185612672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529869.399755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529869.410054:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185612672 00000100:00100000:0.0:1788529869.410077:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185612672 00000100:00100000:0.0:1788529869.410198:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788529869.410211:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185612672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529869.410269:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529869.410390:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185612672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (10635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529869.410398:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788529869.410668:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc881ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185612672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529869.480397:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529869.482966:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158310400 00000100:00100000:2.0:1788529869.482986:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158310400 00000100:00100000:2.0:1788529869.483103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1788529869.483118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+38:10408:x1875409158310400:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:2.0:1788529869.483207:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529869.483242:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e1f expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529869.483268:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529869.483274:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529869.483541:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529869.483560:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529869.483572:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529869.483649:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788529869.483677:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8c339f0 reply state 00000000920539c2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529869.483687:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529869.483841:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+40:10408:x1875409158310400:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 725us (3456us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788529869.483849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000020:00080000:2.0:1788529869.483855:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529869.488177:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488203:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488243:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488250:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529869.488256:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488265:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488287:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529869.488290:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529869.488296:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.488304:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b40e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529869.687293:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529869.687504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158310528 00000100:00100000:1.0:1788529869.687518:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158310528 00000100:00100000:1.0:1788529869.687596:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1788529869.687619:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+39:10422:x1875409158310528:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1788529869.687652:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529869.687681:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e26 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687780:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687799:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687814:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687833:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687841:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.687848:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.692959:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.692995:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693038:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529869.693099:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788529869.693105:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529869.693134:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693150:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693160:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693167:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693175:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693183:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529869.693189:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693554:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693571:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529869.693574:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529869.693580:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693599:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.693889:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694000:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694008:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694013:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529869.694017:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694024:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694035:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc3837f00) 00010000:00010000:1.0:1788529869.694038:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529869.694041:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694047:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694111:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694129:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.694145:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:1.0:1788529869.694148:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529869.694151:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48200, rc 0) 00000100:00100000:0.0:1788529869.697167:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:10422:x1875409158310528:12345-192.168.201.52@tcp:101:stat.0 Request processed in 9534us (9872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529869.697201:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1788529869.846657:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529869.847572:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158310784 00000100:00100000:1.0:1788529869.847584:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158310784 00000100:00100000:1.0:1788529869.847663:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1788529869.847674:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+40:10432:x1875409158310784:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529869.847697:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529869.847719:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b431 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e2d expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529869.847823:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788529869.848009:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b431 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e2d expref: 42 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.848023:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:1.0:1788529869.848027:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529869.848032:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b431 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e2d expref: 42 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529869.848047:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49a00, rc 0) 00000100:00100000:1.0:1788529869.848106:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+41:10432:x1875409158310784:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 432us (1456us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788529869.848113:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1788529869.853485:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529869.854405:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311040 00000100:00100000:1.0:1788529869.854432:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311040 00000100:00100000:1.0:1788529869.854504:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1788529869.854515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+41:10432:x1875409158311040:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788529869.854762:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+42:10432:x1875409158311040:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 248us (1296us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788529869.854769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1788529869.995489:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529869.995574:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311296 00000100:00100000:3.0:1788529869.995585:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311296 00000100:00100000:3.0:1788529869.995655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1788529869.995666:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+42:10438:x1875409158311296:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529869.995692:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529869.995714:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b43f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e34 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.995838:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.995866:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.995876:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.995945:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529869.995964:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 43 pid: 5829 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529869.995979:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185612800:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529869.996092:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc506c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788529870.005466:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185612800:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529870.005502:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529870.007025:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.007238:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311424 00000100:00100000:2.0:1788529870.007249:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311424 00010000:00010000:2.0:1788529870.007296:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 44 pid: 5829 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529870.007342:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:2.0:1788529870.007353:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5075450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+44:2355:x1875409158311424:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529870.007368:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529870.007375:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 44 pid: 5829 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007393:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 44 pid: 5829 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007415:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e26 expref: 44 pid: 5829 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007430:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529870.007436:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007445:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007453:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.007479:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529870.007540:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5075450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+43:2355:x1875409158311424:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.007560:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00010000:00010000:3.0:1788529870.008644:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.008656:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529870.008677:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788529870.008859:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b43f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.008879:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.008886:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.008949:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529870.008953:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529870.009017:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+43:10438:x1875409158311296:12345-192.168.201.52@tcp:101:bash.0 Request processed in 13352us (13536us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788529870.009025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1788529870.011962:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.012049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311680 00000100:00100000:2.0:1788529870.012060:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311680 00000100:00100000:2.0:1788529870.012117:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1788529870.012127:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+43:10438:x1875409158311680:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1788529870.012393:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.012409:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.012419:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529870.012467:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788529870.012493:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033bdccd2 reply state 0000000046222c5c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529870.012502:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529870.012649:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+46:10438:x1875409158311680:12345-192.168.201.52@tcp:36:bash.0 Request processed in 523us (694us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788529870.012657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000020:00080000:2.0:1788529870.012661:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529870.021886:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.021964:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.021972:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.021987:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529870.021992:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.022001:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.022017:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.022021:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529870.022026:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.022032:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b454 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529870.024743:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529870.024844:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311808 00000100:00100000:1.0:1788529870.024854:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311808 00000100:00100000:1.0:1788529870.024944:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1788529870.024955:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:10438:x1875409158311808:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529870.024989:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529870.025011:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b45b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e3b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529870.025117:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529870.025133:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529870.025141:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529870.025193:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529870.025229:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 46 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529870.025244:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185612928:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529870.025317:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2885300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529870.029966:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185612928:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529870.030008:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529870.030992:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.031550:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158311936 00000100:00100000:3.0:1788529870.031560:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158311936 00010000:00010000:3.0:1788529870.031610:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 47 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529870.031662:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1788529870.031672:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+47:2354:x1875409158311936:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529870.031689:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529870.031696:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 47 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031723:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 47 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031747:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b446 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e34 expref: 47 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031764:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.031770:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031779:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031787:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.031818:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529870.031869:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+46:2354:x1875409158311936:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 197us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529870.031877:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00010000:00010000:2.0:1788529870.032185:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.032194:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529870.032262:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788529870.032267:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529870.032286:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.032318:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b45b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e3b expref: 46 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.032333:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e3b expref: 45 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.032339:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529870.032342:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529870.032344:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:2.0:1788529870.032386:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:10438:x1875409158311808:12345-192.168.201.52@tcp:101:bash.0 Request processed in 7433us (7653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.032393:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1788529870.038163:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529870.038249:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312192 00000100:00100000:1.0:1788529870.038260:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312192 00000100:00100000:1.0:1788529870.038308:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1788529870.038318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:10438:x1875409158312192:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1788529870.038649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+46:10438:x1875409158312192:12345-192.168.201.52@tcp:35:bash.0 Request processed in 330us (494us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788529870.038656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1788529870.107002:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.107066:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.107098:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.107193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312576 00000100:00100000:2.0:1788529870.107205:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312576 00000100:00100000:2.0:1788529870.107283:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:2.0:1788529870.107294:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158312576:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529870.107371:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158312576:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.107379:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:0.0:1788529870.107683:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312320 00000100:00100000:0.0:1788529870.107688:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312320 00000100:00100000:0.0:1788529870.107732:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 325 00000100:00100000:0.0:1788529870.107740:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158312320:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529870.107777:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158312320:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 38us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529870.107785:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 325 00000100:00080000:3.0:1788529870.108080:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529870.108395:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312448 00000100:00100000:1.0:1788529870.108401:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312448 00000100:00100000:1.0:1788529870.108452:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:1.0:1788529870.108460:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158312448:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529870.108509:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158312448:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 50us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529870.108516:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00080000:3.0:1788529870.108705:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529870.147574:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.147683:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312832 00000100:00100000:3.0:1788529870.147694:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312832 00000100:00100000:3.0:1788529870.147766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:3.0:1788529870.147777:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+46:10448:x1875409158312832:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529870.147803:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529870.147826:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e42 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529870.147937:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788529870.148076:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b469 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e42 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.148090:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:3.0:1788529870.148093:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529870.148098:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e42 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.148112:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529870.148182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+47:10448:x1875409158312832:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 406us (616us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788529870.148189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1788529870.152358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.152460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158312960 00000100:00100000:2.0:1788529870.152469:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158312960 00000100:00100000:2.0:1788529870.152529:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1788529870.152540:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+47:10448:x1875409158312960:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1788529870.152623:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152640:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152651:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152666:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152673:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152678:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152783:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152792:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152799:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529870.152849:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152875:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152882:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.152888:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153199:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.153204:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153212:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153225:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529870.153228:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529870.153232:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153239:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153253:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153258:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153263:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153276:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.153279:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153286:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153294:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc8c54900) 00010000:00010000:2.0:1788529870.153296:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529870.153299:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153305:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b47e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153322:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153328:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153333:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153338:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.153341:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153347:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153367:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529870.153369:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529870.153372:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.153378:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529870.153457:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+47:10448:x1875409158312960:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 917us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.153466:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1788529870.156415:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.156503:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158313216 00000100:00100000:3.0:1788529870.156513:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158313216 00000100:00100000:3.0:1788529870.156567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1788529870.156589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+47:10448:x1875409158313216:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529870.156848:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+48:10448:x1875409158313216:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 259us (441us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788529870.156856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1788529870.157247:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529870.208837:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.210340:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158313472 00000100:00100000:3.0:1788529870.210354:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158313472 00000100:00100000:3.0:1788529870.210484:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1788529870.210494:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+48:10451:x1875409158313472:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529870.210522:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529870.210544:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b48c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e49 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210872:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210888:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210913:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210927:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210934:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.210940:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211074:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b4a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211083:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211090:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529870.211100:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788529870.211188:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211196:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211203:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211272:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529870.211276:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211284:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211296:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529870.211299:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529870.211304:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211320:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211333:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211340:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211346:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211351:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529870.211354:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211359:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211366:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230b00) 00010000:00010000:3.0:1788529870.211368:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529870.211371:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211376:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b49a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211413:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b48c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e49 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211425:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e49 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.211439:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.211441:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529870.211444:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:3.0:1788529870.211559:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+50:10451:x1875409158313472:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1066us (2732us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788529870.211566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1788529870.216427:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.216531:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158313600 00000100:00100000:2.0:1788529870.216541:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158313600 00000100:00100000:2.0:1788529870.216613:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:2.0:1788529870.216623:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:10451:x1875409158313600:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1788529870.216721:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216741:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216753:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216780:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216787:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216803:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216808:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.216812:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216819:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216831:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529870.216835:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788529870.216840:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.216846:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529870.216950:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:10451:x1875409158313600:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 328us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.216958:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1788529870.219446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.219527:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158313856 00000100:00100000:3.0:1788529870.219536:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158313856 00000100:00100000:3.0:1788529870.219603:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1788529870.219614:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+50:10451:x1875409158313856:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529870.220188:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:10451:x1875409158313856:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 574us (747us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788529870.220195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1788529870.226389:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.226472:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158313984 00000100:00100000:2.0:1788529870.226480:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158313984 00000100:00100000:2.0:1788529870.226544:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1788529870.226553:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:2355:x1875409158313984:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529870.226568:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529870.226591:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b4a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e49 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.226638:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:2.0:1788529870.226644:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529870.226699:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+50:2355:x1875409158313984:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 147us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.226711:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000040:00080000:2.0:1788529870.349741:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788529870.429011:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.430396:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158314240 00000100:00100000:2.0:1788529870.430407:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158314240 00000100:00100000:3.0:1788529870.435385:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1788529870.435400:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+50:10469:x1875409158314240:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:3.0:1788529870.435426:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529870.435448:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e50 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.435545:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.435559:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.435591:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529870.435605:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788529870.435874:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e50 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.435928:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e50 expref: 52 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.435938:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.435941:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788529870.435945:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529870.436098:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:10469:x1875409158314240:12345-192.168.201.52@tcp:101:cat.0 Request processed in 691us (7087us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788529870.436106:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1788529870.466956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.467032:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158314368 00000100:00100000:2.0:1788529870.467044:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158314368 00000100:00100000:2.0:1788529870.467108:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1788529870.467119:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+52:10470:x1875409158314368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529870.467145:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529870.467167:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e57 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467314:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467329:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467342:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529870.467380:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788529870.467384:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529870.467402:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467444:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b4cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e57 expref: 54 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467526:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e57 expref: 53 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.467535:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529870.467538:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788529870.467542:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101c00, rc 0) 00000100:00100000:2.0:1788529870.468268:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+53:10470:x1875409158314368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1147us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.468277:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1788529870.473225:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529870.473530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158314752 00000100:00100000:1.0:1788529870.473553:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158314752 00000100:00100000:1.0:1788529870.473671:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1788529870.473683:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+53:10470:x1875409158314752:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788529870.474721:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:10470:x1875409158314752:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 1027us (1501us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788529870.474731:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1788529870.478267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.478375:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158314880 00000100:00100000:3.0:1788529870.478385:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158314880 00000100:00100000:3.0:1788529870.478535:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1788529870.478547:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+54:10470:x1875409158314880:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:3.0:1788529870.478568:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788529870.478603:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e3b expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.478626:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e50 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.478662:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b36d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dfc expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.478673:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837d00) 00010000:00010000:3.0:1788529870.478684:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529870.478740:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+51:10470:x1875409158314880:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 196us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529870.478748:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1788529870.481096:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529870.481169:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315008 00000100:00100000:3.0:1788529870.481179:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315008 00000100:00100000:3.0:1788529870.481244:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1788529870.481254:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+51:10470:x1875409158315008:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:3.0:1788529870.481379:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.481394:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529870.481405:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529870.481742:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529870.482007:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788529870.482068:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788529870.482169:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+51:10470:x1875409158315008:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 913us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529870.482177:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:0.0:1788529870.509692:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529870.509965:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315136 00000100:00100000:2.0:1788529870.509988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315136 00000100:00100000:2.0:1788529870.510054:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1788529870.510065:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:10472:x1875409158315136:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529870.510089:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529870.510110:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b4e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510181:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510196:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510217:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510250:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510258:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510265:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510356:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510365:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510371:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529870.510411:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788529870.510415:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529870.510434:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510447:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510455:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510462:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510479:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510486:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.510490:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510498:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510511:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529870.510514:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529870.510520:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510527:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b4e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510542:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510550:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510555:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510561:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529870.510564:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510580:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510700:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc8c54900) 00010000:00010000:2.0:1788529870.510703:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529870.510854:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.510861:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b4ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.511104:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b4e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.511121:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529870.511129:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:2.0:1788529870.511132:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788529870.511135:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100600, rc 0) 00000100:00100000:2.0:1788529870.511207:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10472:x1875409158315136:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1137us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529870.511215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00010000:00010000:2.0:1788529871.181455:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529871.373092:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529871.373100:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529871.373137:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788529871.373143:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529871.373256:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185613056:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788529871.373341:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc13c5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788529871.381230:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185613056:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788529871.386850:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.386936:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315264 00000100:00100000:1.0:1788529871.386947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315264 00000100:00100000:1.0:1788529871.387173:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1788529871.387185:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315264:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788529871.387267:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315264:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 84us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.387274:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00080000:3.0:1788529871.387331:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788529871.401407:0:12018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529871.401416:0:12018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529871.401451:0:12018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788529871.401457:0:12018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788529871.402707:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.402747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315392 00000100:00100000:1.0:1788529871.402757:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315392 00000100:00100000:1.0:1788529871.402812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1788529871.402822:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315392:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788529871.402853:0:5831:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788529871.403116:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315392:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 294us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.403123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1788529871.416686:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.417454:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315520 00000100:00100000:3.0:1788529871.417465:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315520 00000100:00100000:3.0:1788529871.423818:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1788529871.423840:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315520:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788529871.424125:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424142:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424153:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424588:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424597:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424605:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424633:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424641:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424647:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529871.424699:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788529871.424703:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529871.424716:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424728:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424734:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424741:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424747:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.424751:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424759:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424771:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:3.0:1788529871.424774:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.424780:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424786:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b4fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424797:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424813:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424818:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424823:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.424826:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424833:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424841:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cabc9230a00) 00010000:00010000:3.0:1788529871.424844:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.424846:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424852:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b503 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424866:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424871:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424877:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424881:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.424890:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424924:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424933:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529871.424935:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.424938:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.424944:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b50a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.425040:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315520:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 1206us (8362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529871.425048:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1788529871.432224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.432355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315776 00000100:00100000:1.0:1788529871.432367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315776 00000100:00100000:1.0:1788529871.432429:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:1.0:1788529871.432440:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:10483:x1875409158315776:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.432475:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529871.432498:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b511 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e65 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432602:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432617:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432630:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529871.432642:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788529871.432744:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432752:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432759:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432765:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529871.432769:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432776:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432787:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:1.0:1788529871.432796:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529871.432803:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432809:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432854:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b511 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e65 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432865:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529871.432868:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529871.432871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b511 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e65 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.432880:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49800, rc 0) 00000100:00100000:1.0:1788529871.432975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158315776:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 537us (764us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788529871.432983:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000004:00080000:2.0:1788529871.438576:0:6913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381408679469ns, next at 382408676544ns, rc = 0 00000100:00100000:2.0:1788529871.438609:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185613184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529871.438678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529871.438741:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185613184 00000100:00100000:2.0:1788529871.438749:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185613184 00000100:00100000:2.0:1788529871.438808:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788529871.438818:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185613184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788529871.438862:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529871.438927:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185613184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529871.438936:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788529871.438997:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185613184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788529871.440428:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529871.441992:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.442444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158315904 00000100:00100000:3.0:1788529871.442462:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158315904 00000100:00100000:3.0:1788529871.442537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1788529871.442551:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158315904:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788529871.442726:0:5830:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788529871.442975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158315904:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 344us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529871.442987:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1788529871.449425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.449547:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158316160 00000100:00100000:1.0:1788529871.449557:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158316160 00000100:00100000:1.0:1788529871.449623:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1788529871.449635:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158316160:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.449656:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529871.449659:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788529871.449684:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b4d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e57 expref: 53 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.449703:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529871.449717:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529871.449732:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b526 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788529871.450413:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788529871.453725:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b52d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.453749:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.453761:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.453838:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e6c expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.453856:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e6c expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.453864:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc3837f00) 00010000:00010000:1.0:1788529871.453867:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529871.453871:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:1.0:1788529871.453976:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:10483:x1875409158316160:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4343us (4559us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788529871.453986:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1788529871.462296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.462367:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158316416 00000100:00100000:3.0:1788529871.462378:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158316416 00000100:00100000:3.0:1788529871.462449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:3.0:1788529871.462460:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:10483:x1875409158316416:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529871.462516:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529871.462543:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b52d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e6c expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462562:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc3837f00) 00010000:00010000:3.0:1788529871.462583:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529871.462605:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462618:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462629:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462681:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462690:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462697:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462756:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462764:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462781:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462787:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.462792:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462799:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462808:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529871.462811:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.462814:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462821:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b53b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462831:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462837:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462843:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462847:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.462850:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462868:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462875:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa1ae0bab (ffff8cabc9230a00) 00010000:00010000:3.0:1788529871.462877:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.462880:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.462885:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b542 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa1ae0bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.463005:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158316416:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 546us (719us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788529871.463012:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:1.0:1788529871.467431:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.467588:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158316544 00000100:00100000:3.0:1788529871.467599:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158316544 00000100:00100000:3.0:1788529871.467657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1788529871.467668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+53:10483:x1875409158316544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529871.467690:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529871.467714:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e73 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467753:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467767:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467778:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467885:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467922:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.467931:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:3.0:1788529871.467935:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788529871.467938:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:3.0:1788529871.468009:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:10483:x1875409158316544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 344us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529871.468017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1788529871.470321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.470380:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158316800 00000100:00100000:3.0:1788529871.470393:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158316800 00000100:00100000:3.0:1788529871.471023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:3.0:1788529871.471039:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:10483:x1875409158316800:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529871.471151:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.471172:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.471199:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529871.472768:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788529871.472798:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381442903655ns, next at 382442900022ns, rc = 0 00000004:00010000:3.0:1788529871.472940:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e5ca0c4 reply state 0000000099a73feb transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.472964:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529871.473119:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+56:10483:x1875409158316800:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 2079us (2807us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788529871.473128:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:0.0:1788529871.482949:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.482991:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158316928 00000100:00100000:0.0:1788529871.483008:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158316928 00000100:00100000:0.0:1788529871.483063:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1788529871.483073:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+56:10483:x1875409158316928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529871.483097:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529871.483119:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e7a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.483193:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.483207:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.483229:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:0.0:1788529871.483232:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529871.483235:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00000100:00100000:0.0:1788529871.483294:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:10483:x1875409158316928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 221us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529871.483301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00010000:00010000:3.0:1788529871.483945:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.483964:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.483972:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.483979:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.483984:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.483991:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.484003:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:3.0:1788529871.484006:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788529871.484010:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.484017:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529871.485495:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.485573:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317056 00000100:00100000:3.0:1788529871.485583:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317056 00000100:00100000:3.0:1788529871.485624:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:3.0:1788529871.485631:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158317056:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788529871.485817:0:6688:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1788529871.485844:0:6688:0:(genops.c:1385:class_connect()) connect: client 14b4f045-1109-44f4-a991-3ed448c68aea, cookie 0xaa46022e3f18b565 00002000:00100000:3.0:1788529871.485856:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14b4f045-1109-44f4-a991-3ed448c68aea/ffff8cabfc238800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788529871.485878:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788529871.486256:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788529871.486286:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cabfc23b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529871.486392:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2353:x1875409158317056:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 Request processed in 759us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529871.486400:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1788529871.501368:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.501485:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317184 00000100:00100000:1.0:1788529871.501498:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317184 00000100:00100000:1.0:1788529871.501571:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1788529871.501582:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:0:x1875409158317184:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788529871.502731:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529871.626865:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:0:x1875409158317184:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 125274us (125496us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788529871.626877:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000001:00080000:3.0:1788529871.627198:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788529871.627210:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000100:00100000:1.0:1788529871.635451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.635552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317440 00000100:00100000:0.0:1788529871.635563:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317440 00000100:00100000:0.0:1788529871.635620:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788529871.635630:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+56:10483:x1875409158317440:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788529871.635856:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+57:10483:x1875409158317440:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 227us (415us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788529871.635875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1788529871.645083:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.645206:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317696 00000100:00100000:0.0:1788529871.645216:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317696 00000100:00100000:0.0:1788529871.645277:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:0.0:1788529871.645289:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:10483:x1875409158317696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788529871.645401:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:10483:x1875409158317696:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529871.645409:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:1.0:1788529871.663826:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.669277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317824 00000100:00100000:0.0:1788529871.669294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317824 00000100:00100000:1.0:1788529871.675490:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:1.0:1788529871.675506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:10483:x1875409158317824:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.675526:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529871.675547:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b56c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e81 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675619:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675635:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675645:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529871.675679:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529871.675698:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675744:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b56c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e81 expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675760:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e81 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.675768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:1.0:1788529871.675771:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788529871.675775:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49a00, rc 0) 00000100:00100000:1.0:1788529871.676031:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+58:10483:x1875409158317824:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 527us (12212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.676039:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1788529871.684650:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.684735:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158317952 00000100:00100000:1.0:1788529871.684744:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158317952 00000100:00100000:1.0:1788529871.684803:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1788529871.684814:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158317952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.684833:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529871.684856:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e88 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529871.684884:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9acccf, blocks: 0x1 00010000:00010000:1.0:1788529871.684940:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1788529871.684945:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529871.684989:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.685032:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.685046:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48400, rc 0) 00000100:00100000:1.0:1788529871.685100:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158317952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 287us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.686739:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1788529871.689693:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.689784:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318208 00000100:00100000:0.0:1788529871.689793:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318208 00000100:00100000:0.0:1788529871.689856:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1788529871.689867:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+58:10483:x1875409158318208:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788529871.690056:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+58:10483:x1875409158318208:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 189us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529871.690063:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1788529871.697644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.697731:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318336 00000100:00100000:1.0:1788529871.697741:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318336 00000100:00100000:1.0:1788529871.697803:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1788529871.697816:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:10483:x1875409158318336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.697836:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529871.697855:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e8f expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.697941:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.697961:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529871.697966:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529871.697972:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.698007:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.698042:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529871.698058:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185613312:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529871.698166:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2074e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529871.706426:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.706740:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318464 00000100:00100000:3.0:1788529871.706751:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318464 00010000:00010000:3.0:1788529871.706796:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 8 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.706850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1788529871.706860:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158318464:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529871.706876:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529871.706939:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 8 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.707002:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 8 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.707028:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529871.707033:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529871.707042:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.707052:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.707090:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.707116:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185613440:192.168.201.52@tcp:105: 00000100:00100000:3.0:1788529871.707194:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcfc71480 going to sleep for 11 seconds 00010000:00010000:1.0:1788529871.707425:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091483227/0xaa46022e3f18b57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e88 expref: 8 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529871.707439:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185613312:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529871.707464:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.707474:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48200, rc 0) 00000100:00100000:1.0:1788529871.707503:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:10483:x1875409158318336:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 9690us (9873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.707511:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1788529871.709777:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185613440:192.168.201.52@tcp:105: 00010000:00010000:3.0:1788529871.709801:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529871.709852:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158318464:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2993us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529871.709862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1788529871.711598:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529871.711682:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318592 00000100:00100000:3.0:1788529871.711692:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318592 00002000:00100000:3.0:1788529871.711738:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8caac77cfb80 x1875409158318592/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:567/0 lens 504/0 e 0 to 0 dl 1788529882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529871.711763:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8caac77cfb80 with x1875409158318592 ext(0->8) 00002000:00010000:3.0:1788529871.711769:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8caac77cfb80 00000100:00100000:3.0:1788529871.711803:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788529871.711813:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158318592:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788529871.712700:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158318592:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 885us (1105us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788529871.712709:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:3.0:1788529871.712717:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8caac77cfb80 x1875409158318592/t4294967302(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:567/0 lens 504/448 e 0 to 0 dl 1788529882 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529871.712726:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8caac77cfb80 with x1875409158318592 ext(0->8) 00002000:00010000:3.0:1788529871.712730:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8caac77cfb80 00000100:00100000:2.0:1788529871.721615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.722353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318720 00000100:00100000:1.0:1788529871.722365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318720 00000100:00100000:1.0:1788529871.722431:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1788529871.722442:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+58:10483:x1875409158318720:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788529871.849775:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1788529871.850255:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+44:10483:x1875409158318720:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 127805us (128641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529871.850269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000004:00080000:1.0:1788529871.850713:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788529871.850747:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788529871.850800:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788529871.850833:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabc506c0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788529871.850838:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabfccb4600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc506cc00 00000020:00080000:1.0:1788529871.850841:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabfccb4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf6146000 00000020:00080000:1.0:1788529871.850881:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788529871.851074:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788529871.851552:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788529871.852484:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529871.852513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185613696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788529871.852619:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529871.853168:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185613696 00000100:00100000:0.0:1788529871.853183:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185613696 00000100:00100000:0.0:1788529871.853280:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529871.853293:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875409185613696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788529871.853341:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788529871.853389:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9acccb, atime: 0x6a9acccc, ctime: 0x6a9acccb, blocks: 0xb 00010000:00010000:0.0:1788529871.853399:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.853422:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1788529871.853427:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529871.853435:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.853458:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.853469:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.853477:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.853500:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788529871.854225:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875409185613696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 934us (1603us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788529871.854234:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788529871.854273:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529871.854281:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.854299:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529871.854307:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.854317:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.854512:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.854521:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea6d59d/0xaa46022e3f18b588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.854609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529871.854612:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529871.854614:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788529871.854662:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabfce2c000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788529871.854671:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185613696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788529871.861858:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185613568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788529871.862006:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529871.862690:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.881329:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185613568 00000100:00100000:1.0:1788529871.881353:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185613568 00000100:00100000:1.0:1788529871.881475:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158318848 00000100:00100000:1.0:1788529871.881479:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158318848 00000100:00100000:1.0:1788529871.881502:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788529871.881513:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185613568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788529871.882008:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788529871.882013:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788529871 00002000:00010000:1.0:1788529871.882016:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788529871.882018:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788529871 -> 1788529871 00002000:00010000:1.0:1788529871.882020:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788529871.882132:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185613568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 619us (20125us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788529871.882142:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788529871.882168:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000004:00080000:2.0:1788529871.882330:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabf569df80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788529871.882339:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185613568:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788529871.882490:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529871.882536:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158318848:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788529871.977626:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788529871.977657:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788529871.978123:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158318848:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 95941us (115440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529871.978136:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1788529871.982104:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.982821:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319104 00000100:00100000:1.0:1788529871.982833:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319104 00000100:00100000:1.0:1788529871.982932:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:1.0:1788529871.982944:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+13:10483:x1875409158319104:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788529871.983077:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529871.983105:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e81 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.983125:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:1.0:1788529871.983130:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529871.983159:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.983174:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.983256:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788529871.983500:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c20bf15f reply state 000000002ecbc5d9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529871.983782:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788529871.983982:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+14:10483:x1875409158319104:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1039us (1887us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788529871.984000:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:2.0:1788529871.990171:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.991385:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319232 00000100:00100000:1.0:1788529871.991396:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319232 00000100:00100000:1.0:1788529871.991507:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1788529871.991532:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158319232:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788529871.991810:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788529871.991814:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788529871 -> 1788529870 00002000:00010000:1.0:1788529871.991817:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788529868 00002000:00010000:1.0:1788529871.991819:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788529871 -> 1788529870 00002000:00010000:1.0:1788529871.991821:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788529871.991887:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158319232:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 358us (1726us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788529871.991920:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:3.0:1788529871.992212:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992224:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992232:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992239:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529871.992245:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992253:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992283:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:3.0:1788529871.992286:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529871.992291:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529871.992309:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b58f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529871.995733:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529871.995942:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319488 00000100:00100000:0.0:1788529871.995985:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319488 00000100:00100000:0.0:1788529871.996048:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1788529871.996059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:10483:x1875409158319488:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788529871.996140:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.996159:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.996169:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.996204:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.996224:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 13 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529871.996239:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185613824:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529871.996342:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529871.999135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529871.999213:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319616 00000100:00100000:1.0:1788529871.999223:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319616 00010000:00010000:1.0:1788529871.999265:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529871.999304:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1788529871.999315:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:2355:x1875409158319616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529871.999340:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529871.999347:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.999364:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.999387:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:1.0:1788529871.999392:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.999401:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.999421:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529871.999438:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529871.999482:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:2355:x1875409158319616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 169us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529871.999489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00010000:00010000:0.0:1788529871.999776:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e73 expref: 13 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529871.999794:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185613824:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529871.999814:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999823:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999835:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999863:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999870:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999877:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529871.999883:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529871.999887:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.000232:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.000244:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:0.0:1788529872.000247:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788529872.000251:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.000256:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529872.000308:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+12:10483:x1875409158319488:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 4250us (4584us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788529872.000325:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:3.0:1788529872.005644:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529872.005714:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319744 00000100:00100000:0.0:1788529872.005722:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319744 00000100:00100000:0.0:1788529872.005778:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1788529872.005786:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158319744:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788529872.005823:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.005839:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.005845:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529872.005848:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529872.005852:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.005878:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.006193:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 7 pid: 6687 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529872.006209:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185613952:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529872.006283:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529872.008833:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529872.008981:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185613952:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529872.009006:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529872.009119:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158319872 00000100:00100000:1.0:1788529872.009126:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158319872 00010000:00010000:1.0:1788529872.009161:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529872.009263:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1788529872.009273:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158319872:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529872.009289:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529872.009474:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.009491:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.009511:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b210d10/0xaa46022e3f18b581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e8f expref: 8 pid: 6687 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.009526:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529872.009531:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529872.009544:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.009554:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.009621:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529872.009677:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158319872:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 405us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529872.009685:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00010000:00010000:0.0:1788529872.010082:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010093:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010119:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010126:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010133:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010141:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529872.010145:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010154:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010166:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.010267:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b59d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529872.010501:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158319744:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 4713us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529872.010510:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1788529872.015042:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529872.015117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158320128 00000100:00100000:3.0:1788529872.015127:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158320128 00000100:00100000:3.0:1788529872.015173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:3.0:1788529872.015263:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+12:10483:x1875409158320128:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788529872.015355:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015370:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015379:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015580:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015592:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015619:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015650:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.015663:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 13 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529872.015673:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185614080:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529872.015743:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529872.018099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529872.018111:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185614080:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529872.018138:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529872.018233:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158320256 00000100:00100000:1.0:1788529872.018239:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158320256 00010000:00010000:1.0:1788529872.018270:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529872.018307:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1788529872.018316:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:2354:x1875409158320256:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529872.018331:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529872.018338:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018354:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018375:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b55e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e7a expref: 14 pid: 5831 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018390:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:1.0:1788529872.018407:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018417:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018423:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529872.018443:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529872.018465:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.018472:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529872.018496:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:2354:x1875409158320256:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529872.018503:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000001:00080000:3.0:1788529872.018642:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788529872.019154:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788529872.019395:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788529872.019479:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875409185614208:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788529872.019538:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529872.019566:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529872.019638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185614208 00000100:00100000:1.0:1788529872.019644:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185614208 00000100:00100000:1.0:1788529872.019675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788529872.019683:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1875409185614208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788529872.019762:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1875409185614208:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529872.019769:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529872.019792:0:5830:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788529872.019798:0:5830:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabf569df80, transno 4294967303 00000100:00100000:3.0:1788529872.019811:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875409185614208:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788529872.020310:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788529872.020433:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875409185614336:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788529872.020463:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529872.020554:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529872.020594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185614336 00000100:00100000:2.0:1788529872.020599:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185614336 00000100:00100000:2.0:1788529872.020642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529872.020649:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1875409185614336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788529872.021089:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5830:x1875409185614336:12345-0@lo:1000:mdt00_001.0 Request processed in 439us (623us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788529872.021096:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529872.021157:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5830:1875409185614336:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788529872.021260:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021270:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021278:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021283:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529872.021288:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021296:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021311:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc9230600) 00010000:00010000:3.0:1788529872.021314:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529872.021386:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021394:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18b5ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021438:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021445:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021450:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021455:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529872.021458:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021464:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021472:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529872.021474:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529872.021477:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021483:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b4d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021502:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021516:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021524:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021556:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.021572:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 16 pid: 5830 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529872.021585:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185614464:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529872.021688:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529872.027762:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185614464:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529872.027792:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529872.029229:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529872.029440:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158320384 00000100:00100000:3.0:1788529872.029449:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158320384 00010000:00010000:3.0:1788529872.029483:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 17 pid: 5830 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529872.029517:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1788529872.029524:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+17:2354:x1875409158320384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529872.029535:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529872.029540:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 17 pid: 5830 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029552:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 17 pid: 5830 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029591:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b4f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e5e expref: 17 pid: 5830 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029604:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:3.0:1788529872.029607:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029614:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029619:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.029639:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529872.029681:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+16:2354:x1875409158320384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529872.029686:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00010000:00010000:2.0:1788529872.029817:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029823:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029833:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029839:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029845:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029858:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529872.029862:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029870:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029879:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:2.0:1788529872.029882:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529872.029885:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029889:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18b5b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029918:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029922:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029926:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029929:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529872.029931:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029934:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029956:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:2.0:1788529872.029958:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788529872.029962:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529872.029968:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18b5a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529872.030799:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+15:10483:x1875409158320128:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 15536us (15764us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788529872.030809:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000020:00080000:2.0:1788529872.030813:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788529872.032488:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788529872.032495:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788529872.032526:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788529872.032531:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529872.032698:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529872.032762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158320640 00000100:00100000:0.0:1788529872.032771:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158320640 00000100:00100000:0.0:1788529872.032819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1788529872.032828:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+15:10483:x1875409158320640:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788529872.033500:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788529872.033574:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788529872.033618:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033631:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033641:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033647:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033651:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033654:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529872.033675:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788529872.033702:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529872.033720:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.033726:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529872.033729:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.033736:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529872.033748:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:3.0:1788529872.033757:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788529872.033762:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529872.033768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+17:10483:x1875409158320640:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 940us (1072us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1788529872.033769:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b5b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529872.033776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000020:00080000:0.0:1788529872.033781:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529872.033786:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529872.033788:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529872.033790:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529872.205188:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529873.232662:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788529873.445089:0:12071:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788529873.445100:0:12071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788529873.445141:0:12071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788529873.445161:0:12071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788529873.579824:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529873.580078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158320896 00000100:00100000:2.0:1788529873.580089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158320896 00000100:00100000:2.0:1788529873.580157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1788529873.580168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+17:10501:x1875409158320896:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529873.580196:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529873.580219:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e96 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.580319:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b5c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.580333:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.580345:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529873.580370:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:0.0:1788529873.580675:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788529873.580729:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e96 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.580748:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b5c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e96 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.580756:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529873.580759:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788529873.580762:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101800, rc 0) 00000100:00100000:2.0:1788529873.580826:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:10501:x1875409158320896:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 660us (1011us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788529873.580834:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1788529873.588330:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529873.592544:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158321024 00000100:00100000:3.0:1788529873.592559:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158321024 00000100:00100000:3.0:1788529873.592620:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1788529873.592630:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+19:10501:x1875409158321024:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1788529873.592701:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592719:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592731:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592744:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592751:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592757:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592983:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592991:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.592998:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529873.593041:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593053:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593059:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593066:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593072:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.593076:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593084:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593095:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529873.593098:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529873.593103:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593115:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b5d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593128:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593133:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593138:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593143:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.593146:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593151:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593160:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230c00) 00010000:00010000:3.0:1788529873.593162:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529873.593164:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593169:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593182:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593187:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593199:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593204:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.593206:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593212:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593220:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc9230a00) 00010000:00010000:3.0:1788529873.593222:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529873.593225:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.593230:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b5e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529873.593312:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+19:10501:x1875409158321024:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 681us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529873.593320:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000001:00080000:3.0:1788529873.642216:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788529873.647876:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529873.648318:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158321280 00000100:00100000:1.0:1788529873.648329:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158321280 00000100:00100000:1.0:1788529873.648389:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:1.0:1788529873.648400:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:10504:x1875409158321280:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529873.648422:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529873.648464:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b5ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0e9d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648552:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648568:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648580:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648595:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648601:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.648607:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649082:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649092:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649099:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529873.649109:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788529873.649194:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649211:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649218:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649225:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529873.649229:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649237:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649248:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529873.649251:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529873.649257:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649263:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649275:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649281:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649287:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649293:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529873.649301:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649307:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649315:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc3837300) 00010000:00010000:1.0:1788529873.649317:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529873.649320:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649326:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b5f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649373:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b5ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649388:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.649395:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:1.0:1788529873.649397:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529873.649400:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788529873.651085:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:10504:x1875409158321280:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2677us (3207us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788529873.651097:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:1.0:1788529873.660801:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529873.661249:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158321408 00000100:00100000:3.0:1788529873.661260:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158321408 00000100:00100000:3.0:1788529873.661317:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:3.0:1788529873.661327:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+21:10504:x1875409158321408:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1788529873.661393:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661422:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661444:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661477:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661483:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661490:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661496:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.661500:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661507:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661518:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:3.0:1788529873.661521:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529873.661526:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.661532:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18b60d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529873.661608:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+21:10504:x1875409158321408:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 282us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529873.661772:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1788529873.669080:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529873.669177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158321664 00000100:00100000:1.0:1788529873.669188:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158321664 00000100:00100000:1.0:1788529873.669273:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1788529873.669294:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:10504:x1875409158321664:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788529873.669528:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+22:10504:x1875409158321664:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 236us (452us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788529873.669547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1788529873.725054:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529873.725150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158321920 00000100:00100000:2.0:1788529873.725161:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158321920 00000100:00100000:2.0:1788529873.725225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:2.0:1788529873.725236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+22:10023:x1875409158321920:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1788529873.725260:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529873.725284:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b614 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ea4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.725404:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.725419:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.725446:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.725478:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.725495:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 23 pid: 5829 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529873.725509:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185614592:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529873.725607:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529873.729486:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185614592:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529873.729521:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529873.729787:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529873.729864:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322048 00000100:00100000:2.0:1788529873.729872:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322048 00010000:00010000:2.0:1788529873.729960:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 24 pid: 5829 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529873.730005:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1788529873.730015:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+24:2354:x1875409158322048:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529873.730032:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529873.730039:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 24 pid: 5829 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730057:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 24 pid: 5829 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730081:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e9d expref: 24 pid: 5829 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730115:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:2.0:1788529873.730122:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730131:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730138:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.730164:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529873.730235:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:2354:x1875409158322048:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 221us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529873.730243:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00010000:00010000:0.0:1788529873.730307:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.730315:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529873.730333:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788529873.730483:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b614 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.730500:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.730513:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:0.0:1788529873.730516:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788529873.730519:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100800, rc 0) 00000100:00100000:0.0:1788529873.730554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+23:10023:x1875409158321920:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5320us (5509us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788529873.730561:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1788529873.734615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529873.734699:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322304 00000100:00100000:3.0:1788529873.734709:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322304 00000100:00100000:3.0:1788529873.734772:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:3.0:1788529873.734783:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:10023:x1875409158322304:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1788529873.735138:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.735156:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.735169:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529873.735342:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788529873.735369:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085799202 reply state 0000000074533851 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529873.735378:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788529873.735421:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788529873.735520:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+27:10023:x1875409158322304:12345-192.168.201.52@tcp:36:bash.0 Request processed in 739us (914us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788529873.735541:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000020:00080000:2.0:1788529873.735546:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788529873.741223:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529873.741607:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322432 00000100:00100000:1.0:1788529873.741629:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322432 00010000:00010000:3.0:1788529873.741776:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741789:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741795:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741801:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.741807:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741813:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741829:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:3.0:1788529873.741831:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529873.741836:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.741842:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b629 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529873.742015:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:1.0:1788529873.742026:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+26:10023:x1875409158322432:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529873.742050:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529873.742066:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0eab expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.742122:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eab expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.742135:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eab expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.742162:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:1.0:1788529873.742164:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788529873.742166:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529873.742227:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+27:10023:x1875409158322432:12345-192.168.201.52@tcp:101:bash.0 Request processed in 204us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529873.742234:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1788529873.745788:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529873.745957:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322560 00000100:00100000:1.0:1788529873.745968:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322560 00000100:00100000:1.0:1788529873.746045:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1788529873.746056:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:10023:x1875409158322560:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529873.746076:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529873.746097:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0eb2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529873.746123:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9accce, atime: 0x6a9acccc, ctime: 0x6a9accce, blocks: 0xb 00010000:00010000:1.0:1788529873.746145:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1788529873.746150:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529873.746159:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.746176:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529873.746188:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529873.746260:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:10023:x1875409158322560:12345-192.168.201.52@tcp:101:bash.0 Request processed in 206us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529873.746267:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00080000:0.0:1788529873.746820:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529873.749000:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529873.749341:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322688 00000100:00100000:0.0:1788529873.749352:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322688 00002000:00010000:0.0:1788529873.749396:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788529873.749401:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfc253b80 with x1875409158322688 ext(0->18446744073709551615) 00002000:00010000:0.0:1788529873.749412:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfc253b80. 00000100:00100000:0.0:1788529873.749449:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1788529873.749459:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158322688:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:0.0:1788529873.749849:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788529873.749852:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788529870 -> 1788529873 00002000:00010000:0.0:1788529873.749854:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788529868 -> 1788529868 00002000:00010000:0.0:1788529873.749856:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788529870 -> 1788529873 00002000:00010000:0.0:1788529873.749857:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788529873.750029:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158322688:12345-192.168.201.52@tcp:10:bash.0 Request processed in 569us (1036us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788529873.750036:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00010000:0.0:1788529873.750040:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788529873.750043:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfc253b80 with x1875409158322688 ext(0->18446744073709551615) 00002000:00010000:0.0:1788529873.750060:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfc253b80. 00000100:00100000:2.0:1788529873.854029:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529873.854355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158322816 00000100:00100000:0.0:1788529873.854365:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158322816 00000100:00100000:0.0:1788529873.854469:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:0.0:1788529873.854481:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+27:10518:x1875409158322816:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1788529873.855094:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855115:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855127:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855141:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855148:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855154:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855382:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855392:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855399:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529873.855450:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855461:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855468:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855475:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855482:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529873.855486:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855494:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855508:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529873.855511:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529873.855516:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855523:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b63e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855536:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855664:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855675:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855681:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529873.855684:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855690:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855699:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc5e09b00) 00010000:00010000:0.0:1788529873.855701:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529873.855705:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855710:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855726:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855732:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855737:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855742:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529873.855744:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855760:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855768:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:0.0:1788529873.855770:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529873.855773:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.855778:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b64c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529873.856107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+27:10518:x1875409158322816:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1623us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529873.856117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:3.0:1788529873.924621:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529873.924680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158323072 00000100:00100000:0.0:1788529873.924690:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158323072 00000100:00100000:0.0:1788529873.924852:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1788529873.924861:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+27:10521:x1875409158323072:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529873.924879:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529873.924933:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0eb9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925016:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925032:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925043:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925067:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925071:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925076:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925680:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925688:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925693:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529873.925700:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788529873.925988:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925994:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.925999:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926002:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529873.926005:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926019:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529873.926030:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529873.926033:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926038:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b65a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926047:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926050:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926054:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926056:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529873.926058:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926065:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc5e09b00) 00010000:00010000:0.0:1788529873.926066:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529873.926067:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926077:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926113:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb9 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926123:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb9 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529873.926131:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:0.0:1788529873.926133:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788529873.926136:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529873.926312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+29:10521:x1875409158323072:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1451us (1707us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788529873.926320:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:1.0:1788529873.931431:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529873.931769:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158323200 00000100:00100000:2.0:1788529873.931782:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158323200 00000100:00100000:2.0:1788529873.932740:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:2.0:1788529873.932753:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+29:10521:x1875409158323200:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1788529873.932821:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.932838:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.932847:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.932882:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.932924:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 29 pid: 5831 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529873.932939:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185614720:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529873.933022:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529873.939803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529873.939934:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158323456 00000100:00100000:0.0:1788529873.939945:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158323456 00000100:00100000:0.0:1788529873.940008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1788529873.940019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+30:5598:x1875409158323456:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788529873.940354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+31:5598:x1875409158323456:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 336us (561us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788529873.940362:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1788529873.940507:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185614720:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529873.940537:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529873.945456:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529873.946496:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158323584 00000100:00100000:2.0:1788529873.946508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158323584 00010000:00010000:2.0:1788529873.946561:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 31 pid: 5831 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529873.946604:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1788529873.946614:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+31:2354:x1875409158323584:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529873.946629:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529873.946635:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 31 pid: 5831 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946653:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 31 pid: 5831 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946673:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b61b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ea4 expref: 31 pid: 5831 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946691:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:2.0:1788529873.946696:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946716:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946724:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529873.946753:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529873.946806:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+30:2354:x1875409158323584:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 192us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529873.946827:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00010000:00010000:3.0:1788529873.948606:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948620:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948655:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948663:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948670:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948677:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529873.948681:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948689:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948703:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:3.0:1788529873.948717:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529873.948722:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529873.948746:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529873.948836:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+29:10521:x1875409158323200:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 16084us (17412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529873.948845:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1788529873.955288:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529873.955380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158323840 00000100:00100000:0.0:1788529873.955391:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158323840 00000100:00100000:0.0:1788529873.955453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1788529873.955464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+29:10521:x1875409158323840:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529873.955833:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+30:10521:x1875409158323840:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 369us (553us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788529873.955841:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1788529874.133680:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529874.133778:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158324096 00000100:00100000:1.0:1788529874.133788:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158324096 00000100:00100000:1.0:1788529874.133855:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:1.0:1788529874.133867:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+30:10532:x1875409158324096:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1788529874.133959:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529874.133982:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b67d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ec0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134060:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134074:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134087:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134100:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134106:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134112:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134384:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134393:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134399:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529874.134407:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788529874.134502:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134510:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134516:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134521:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529874.134526:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134533:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134544:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529874.134547:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529874.134552:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134559:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134570:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134575:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134581:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134586:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529874.134595:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134601:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134609:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc3837100) 00010000:00010000:1.0:1788529874.134612:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529874.134615:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134621:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b68b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134667:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b67d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec0 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134681:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec0 expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.134688:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:1.0:1788529874.134691:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529874.134693:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:1.0:1788529874.134766:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+32:10532:x1875409158324096:12345-192.168.201.52@tcp:101:cat.0 Request processed in 901us (1095us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788529874.134772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:2.0:1788529874.150323:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529874.150432:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158324352 00000100:00100000:1.0:1788529874.150442:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158324352 00000100:00100000:1.0:1788529874.150501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1788529874.150512:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+32:10532:x1875409158324352:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:1.0:1788529874.150788:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+33:10532:x1875409158324352:12345-192.168.201.52@tcp:35:cat.0 Request processed in 276us (473us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788529874.150796:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:3.0:1788529874.186190:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.187759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158324608 00000100:00100000:0.0:1788529874.187774:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158324608 00000100:00100000:0.0:1788529874.187855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:0.0:1788529874.187866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+33:10533:x1875409158324608:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1788529874.187970:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788529874.187996:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec0 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188018:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb9 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188031:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eab expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188042:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc3837700) 00010000:00010000:0.0:1788529874.188053:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529874.188075:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188089:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188100:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188136:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188143:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188150:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188387:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188397:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.188404:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529874.189215:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788529874.189225:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384159330836ns, next at 385159328796ns, rc = 0 00010000:00010000:0.0:1788529874.189286:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.189297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.189305:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.189313:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.189329:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.189336:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190665:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529874.190700:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190709:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190716:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190722:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.190726:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190734:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190749:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:0.0:1788529874.190752:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788529874.190756:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190763:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190787:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190806:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190812:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190818:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.190821:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190827:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190836:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529874.190839:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529874.190843:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.190848:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529874.190859:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d59b96a0 reply state 000000003cd984a7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529874.190868:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788529874.191004:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:10533:x1875409158324608:12345-192.168.201.52@tcp:36:rm.0 Request processed in 3135us (4820us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788529874.191013:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00010000:00010000:3.0:1788529874.197723:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529874.197743:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.197756:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529874.197761:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.197772:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.197791:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529874.197794:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788529874.197799:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.197805:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b6b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.197833:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529874.197835:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529874.197837:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529874.205389:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205428:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205436:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205441:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.205446:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205454:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205471:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc5e09b00) 00010000:00010000:0.0:1788529874.205474:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529874.205479:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.205485:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.253162:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529874.274403:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.274636:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158324864 00000100:00100000:0.0:1788529874.274645:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158324864 00000100:00100000:0.0:1788529874.274714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:0.0:1788529874.274726:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+31:10540:x1875409158324864:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529874.274751:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.274773:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.274967:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.274981:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.274992:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275006:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275012:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275018:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788529874.275625:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788529874.275790:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275801:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275808:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275841:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275860:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275867:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275873:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.275878:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275886:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275940:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529874.275945:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529874.275950:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.275957:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529874.275970:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3b6cc46 reply state 000000005d3c5e14 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529874.275979:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788529874.276013:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.276025:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.276043:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:0.0:1788529874.276046:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529874.276048:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529874.276113:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+34:10540:x1875409158324864:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1390us (1721us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788529874.276121:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00010000:00010000:3.0:1788529874.280053:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280072:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280080:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280087:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529874.280091:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280100:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280116:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc5e09b00) 00010000:00010000:3.0:1788529874.280119:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529874.280124:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.280131:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b6ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529874.282951:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.283940:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158324992 00000100:00100000:0.0:1788529874.283952:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158324992 00000100:00100000:0.0:1788529874.284026:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1788529874.284037:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158324992:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529874.284055:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.284079:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ece expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529874.284107:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529874.284124:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788529874.284129:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529874.284139:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.284159:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.284172:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00000100:00100000:0.0:1788529874.284234:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158324992:12345-192.168.201.52@tcp:101:bash.0 Request processed in 199us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.284255:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00080000:2.0:1788529874.284763:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529874.291980:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.292074:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158325120 00000100:00100000:3.0:1788529874.292085:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158325120 00000100:00100000:3.0:1788529874.292148:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1788529874.292159:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:10540:x1875409158325120:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529874.292179:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529874.292217:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ed5 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.292252:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.292261:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529874.292265:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529874.292270:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.292309:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.292326:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529874.292341:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185614848:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529874.292445:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529874.294648:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185614848:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529874.294686:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.294708:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:0.0:1788529874.294776:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:10540:x1875409158325120:12345-192.168.201.52@tcp:101:bash.0 Request processed in 2618us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.294786:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:1.0:1788529874.297262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529874.300351:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158325248 00000100:00100000:2.0:1788529874.300371:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158325248 00010000:00010000:2.0:1788529874.300428:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529874.300476:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1788529874.300487:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158325248:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529874.300505:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529874.300531:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.300560:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.300585:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b6df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ece expref: 7 pid: 6687 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.300603:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529874.300607:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529874.300616:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.300640:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529874.300682:0:8455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529874.300698:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc252a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8455:1875409185614976:192.168.201.52@tcp:105: 00000100:00100000:2.0:1788529874.300786:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529874.310314:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc252a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8455:1875409185614976:192.168.201.52@tcp:105: 00010000:00010000:3.0:1788529874.310342:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529874.310401:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158325248:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 9916us (13151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.310411:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1788529874.312703:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.312786:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158325504 00000100:00100000:0.0:1788529874.312796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158325504 00000100:00100000:0.0:1788529874.312855:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1788529874.312865:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+33:10540:x1875409158325504:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1788529874.313255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:10540:x1875409158325504:12345-192.168.201.52@tcp:35:bash.0 Request processed in 390us (559us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788529874.313263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1788529874.509295:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529874.509329:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185615104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529874.509405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529874.509666:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615104 00000100:00100000:0.0:1788529874.509675:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615104 00000100:00100000:0.0:1788529874.509754:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788529874.509765:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185615104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529874.509800:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529874.509847:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185615104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.509853:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788529874.510012:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529874.510048:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185615104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529874.510500:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185615488:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510535:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529874.510562:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788529874.510568:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185615360:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529874.510614:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185615232:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529874.510666:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185615744:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529874.510703:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529874.510727:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185615616:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529874.510778:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615232 00000100:00100000:2.0:1788529874.510782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615232 00000100:00100000:2.0:1788529874.510812:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788529874.510818:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185615232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.510852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185615232:12345-0@lo:400:kworker.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529874.510859:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788529874.510943:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185615232:0@lo:400:kworker.0 00000100:00100000:3.0:1788529874.511012:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615488 00000100:00100000:3.0:1788529874.511023:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615488 00000100:00100000:3.0:1788529874.511063:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615360 00000100:00100000:3.0:1788529874.511066:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615360 00000100:00100000:3.0:1788529874.511077:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615744 00000100:00100000:3.0:1788529874.511079:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615744 00000100:00100000:3.0:1788529874.511093:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788529874.511099:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185615488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529874.511147:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185615488:12345-0@lo:400:kworker.0 Request processed in 49us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.511154:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788529874.511166:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788529874.511172:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185615360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529874.511198:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185615360:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.511204:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788529874.511216:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788529874.511222:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185615744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529874.511251:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185615744:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.511257:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788529874.511438:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185615616 00000100:00100000:1.0:1788529874.511442:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185615616 00000100:00100000:1.0:1788529874.511479:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788529874.511487:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185615616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529874.511518:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185615616:12345-0@lo:400:kworker.0 Request processed in 33us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529874.511524:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788529874.511682:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788529874.511687:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529874.511724:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185615360:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.511737:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185615488:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.511765:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788529874.511771:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788529874.511784:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabfce2c000, transno 4294967301 00000100:00100000:2.0:1788529874.511799:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185615616:0@lo:400:kworker.0 00000100:00100000:2.0:1788529874.511809:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185615744:0@lo:400:kworker.0 00000100:00100000:1.0:1788529874.580945:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.581060:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158325632 00000100:00100000:3.0:1788529874.581070:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158325632 00000100:00100000:0.0:1788529874.581240:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1788529874.581267:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+34:10556:x1875409158325632:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529874.581294:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.581318:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0edc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581386:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581402:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581415:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529874.581450:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788529874.581455:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529874.581470:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581494:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0edc expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581512:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0edc expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.581521:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529874.581524:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788529874.581528:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df600, rc 0) 00000100:00100000:0.0:1788529874.581594:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+35:10556:x1875409158325632:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 331us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.581612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:2.0:1788529874.595799:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.595941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158325888 00000100:00100000:0.0:1788529874.595953:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158325888 00000100:00100000:0.0:1788529874.596020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:0.0:1788529874.596032:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:10556:x1875409158325888:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529874.596054:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.596074:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ee3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.596290:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.596303:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.596315:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529874.596325:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788529874.596459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b6fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ee3 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.596479:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ee3 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.596488:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:0.0:1788529874.596491:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529874.596494:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df000, rc 0) 00000100:00100000:0.0:1788529874.596637:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+37:10556:x1875409158325888:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 606us (848us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788529874.596645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1788529874.608615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.608711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326016 00000100:00100000:3.0:1788529874.608723:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326016 00000100:00100000:3.0:1788529874.608791:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1788529874.608802:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+37:2354:x1875409158326016:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529874.608821:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529874.608861:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ee3 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.608881:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:3.0:1788529874.608886:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529874.608998:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+36:2354:x1875409158326016:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 198us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.609007:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1788529874.625675:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.625786:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326272 00000100:00100000:0.0:1788529874.625797:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326272 00000100:00100000:0.0:1788529874.625856:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:0.0:1788529874.625867:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+36:10556:x1875409158326272:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529874.625891:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.625951:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0eea expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.626068:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.626085:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.626097:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529874.626112:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788529874.626265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eea expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.626283:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eea expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.626292:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:0.0:1788529874.626294:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788529874.626315:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df000, rc 0) 00000100:00100000:0.0:1788529874.626406:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+38:10556:x1875409158326272:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 539us (738us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788529874.626414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:2.0:1788529874.637169:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.637261:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326400 00000100:00100000:0.0:1788529874.637272:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326400 00000100:00100000:0.0:1788529874.637335:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1788529874.637345:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158326400:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:0.0:1788529874.637401:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.637436:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.637448:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529874.637451:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529874.637456:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.637495:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.637512:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 6 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529874.637528:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185615872:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529874.637638:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529874.640260:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185615872:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529874.640288:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529874.641264:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.641353:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326528 00000100:00100000:0.0:1788529874.641361:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326528 00002000:00100000:0.0:1788529874.641407:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cabf5f3d180 x1875409158326528/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:570/0 lens 504/0 e 0 to 0 dl 1788529885 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529874.641428:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf5f3d180 with x1875409158326528 ext(0->8) 00010000:00010000:0.0:1788529874.641437:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 7 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.641456:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 7 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529874.641464:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabf5f3d180 00000100:00100000:0.0:1788529874.641494:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1788529874.641504:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158326528:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:0.0:1788529874.642099:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158326528:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 593us (837us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788529874.642108:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00100000:0.0:1788529874.642116:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cabf5f3d180 x1875409158326528/t4294967302(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:570/0 lens 504/448 e 0 to 0 dl 1788529885 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529874.642125:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf5f3d180 with x1875409158326528 ext(0->8) 00010000:00010000:0.0:1788529874.642131:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.642150:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529874.642158:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabf5f3d180 00000100:00100000:2.0:1788529874.648795:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529874.648940:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326656 00000100:00100000:1.0:1788529874.648955:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326656 00010000:00010000:1.0:1788529874.648997:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529874.649039:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1788529874.649049:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+9:2354:x1875409158326656:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529874.649065:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788529874.649083:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788529874.649086:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788529874 00002000:00010000:1.0:1788529874.649088:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788529874 00002000:00010000:1.0:1788529874.649090:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788529874 00010000:00010000:1.0:1788529874.649095:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.649126:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.649149:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221f1e50/0xaa46022e3f18b6e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ed5 expref: 9 pid: 6688 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.649166:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529874.649171:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529874.649177:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.649187:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.649211:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529874.649270:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158326656:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 221us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529874.649279:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00010000:00010000:0.0:1788529874.650839:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650855:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650886:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650939:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650948:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650955:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529874.650961:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.650970:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.651009:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.651017:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18b725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529874.651114:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158326400:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 13767us (13951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.651124:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1788529874.664958:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.665181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158326912 00000100:00100000:0.0:1788529874.665191:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158326912 00000100:00100000:0.0:1788529874.665310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1788529874.665323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+38:10556:x1875409158326912:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:0.0:1788529874.665389:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eea expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788529874.665666:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788529874.665712:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788529874.666082:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788529874.666141:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.666157:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.666166:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.666212:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.666231:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 42 pid: 5831 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529874.666246:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875409185616000:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529874.666322:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529874.672869:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875409185616000:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529874.672943:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529874.686783:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.687238:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327040 00000100:00100000:3.0:1788529874.687249:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327040 00010000:00010000:3.0:1788529874.687290:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 43 pid: 5831 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529874.687326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1788529874.687336:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5075050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+43:2355:x1875409158327040:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529874.687350:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529874.687357:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 43 pid: 5831 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687376:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 43 pid: 5831 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687397:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b6d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ec7 expref: 43 pid: 5831 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687415:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:3.0:1788529874.687421:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687445:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687453:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.687487:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529874.687554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5075050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+42:2355:x1875409158327040:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 219us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.687562:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00010000:00010000:0.0:1788529874.687813:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.687837:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788529874.688054:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788529874.688250:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788529874.688367:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185616128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788529874.688413:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529874.688443:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529874.688786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185616128 00000100:00100000:3.0:1788529874.688792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185616128 00000100:00100000:3.0:1788529874.688824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788529874.688831:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185616128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788529874.688935:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185616128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.688942:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788529874.689039:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185616128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788529874.689460:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788529874.695045:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185616256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788529874.695150:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529874.695181:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529874.695421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185616256 00000100:00100000:2.0:1788529874.695430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185616256 00000100:00100000:2.0:1788529874.695473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529874.695483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875409185616256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788529874.695729:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875409185616256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 246us (579us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788529874.695737:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788529874.695974:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875409185616256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788529874.696048:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788529874.696096:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696107:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696127:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696133:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529874.696138:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696146:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696161:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:1.0:1788529874.696164:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788529874.696168:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.696175:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b72c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788529874.696361:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788529874.696453:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788529874.696464:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384666569456ns, next at 385666567732ns, rc = 0 00000001:00080000:1.0:1788529874.696470:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788529874.696504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09200) 00010000:00010000:1.0:1788529874.696507:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788529874.696514:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b717 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eea expref: 46 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529874.696605:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+45:10556:x1875409158326912:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 31285us (31658us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788529874.696622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000020:00080000:1.0:1788529874.696626:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788529874.711882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.712034:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327168 00000100:00100000:0.0:1788529874.712045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327168 00000100:00100000:0.0:1788529874.712111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:0.0:1788529874.712123:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+45:10556:x1875409158327168:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529874.712147:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.712170:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b733 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ef1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.712233:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef1 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.712248:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef1 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.712268:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529874.712271:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529874.712275:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00000100:00100000:0.0:1788529874.712345:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+46:10556:x1875409158327168:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 224us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529874.712353:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1788529874.739861:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529874.740087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327424 00000100:00100000:1.0:1788529874.740097:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327424 00000100:00100000:1.0:1788529874.740166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1788529874.740177:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+46:10556:x1875409158327424:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788529874.740411:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+47:10556:x1875409158327424:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 236us (560us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788529874.740427:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1788529874.874746:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.874841:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327552 00000100:00100000:3.0:1788529874.874852:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327552 00000100:00100000:3.0:1788529874.874990:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:3.0:1788529874.875002:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+47:10566:x1875409158327552:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1788529874.875092:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875111:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875137:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875153:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875160:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875166:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875253:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875261:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875268:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529874.875311:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875324:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875331:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875339:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875357:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529874.875362:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875370:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875382:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529874.875385:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529874.875390:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875397:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b73a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875412:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875418:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875423:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875428:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529874.875430:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875436:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875454:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc9230a00) 00010000:00010000:3.0:1788529874.875457:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529874.875460:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875466:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875483:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875489:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875496:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875501:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529874.875504:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875510:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875518:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529874.875520:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529874.875523:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529874.875529:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529874.875619:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+47:10566:x1875409158327552:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 619us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529874.875628:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:2.0:1788529874.935594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529874.935726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327808 00000100:00100000:0.0:1788529874.935734:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327808 00000100:00100000:0.0:1788529874.935807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1788529874.935816:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+47:10569:x1875409158327808:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529874.935835:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529874.935865:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b74f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ef8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.935988:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936004:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936015:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936028:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936034:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936041:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936160:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936169:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936176:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529874.936186:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788529874.936279:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936292:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936296:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936300:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.936303:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936308:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936318:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529874.936320:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529874.936325:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936330:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b756 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936342:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936349:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936356:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936361:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529874.936368:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936375:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936382:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc5e09800) 00010000:00010000:0.0:1788529874.936384:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529874.936386:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936392:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b75d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936429:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b74f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936442:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529874.936450:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529874.936452:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529874.936454:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529874.936521:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+49:10569:x1875409158327808:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 706us (935us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788529874.936528:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1788529874.939107:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529874.939222:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158327936 00000100:00100000:1.0:1788529874.939232:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158327936 00000100:00100000:1.0:1788529874.939292:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:1.0:1788529874.939302:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+49:10569:x1875409158327936:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1788529874.939364:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939380:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939392:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939417:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939424:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939449:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939455:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529874.939459:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939467:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939479:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529874.939481:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529874.939486:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529874.939492:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529874.939665:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+49:10569:x1875409158327936:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 363us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529874.939673:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:1.0:1788529874.942410:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529874.942484:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158328192 00000100:00100000:3.0:1788529874.942492:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158328192 00000100:00100000:3.0:1788529874.942587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1788529874.942600:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+49:10569:x1875409158328192:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529874.942848:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+50:10569:x1875409158328192:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 251us (446us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788529874.942854:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:2.0:1788529874.998036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.001471:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158328448 00000100:00100000:0.0:1788529875.001486:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158328448 00000100:00100000:0.0:1788529875.001955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:0.0:1788529875.001980:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+50:10579:x1875409158328448:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529875.002007:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529875.002010:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788529875.002036:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b6f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0edc expref: 50 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002056:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529875.002061:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529875.002076:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b779 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0eff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002173:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002188:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002197:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002231:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.002249:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 50 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529875.002263:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185616384:192.168.201.52@tcp:104: 00000100:00080000:2.0:1788529875.002438:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529875.002497:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529875.011832:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.012233:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158328576 00000100:00100000:3.0:1788529875.012243:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158328576 00010000:00010000:3.0:1788529875.012290:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 51 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529875.012334:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:3.0:1788529875.012344:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+51:2355:x1875409158328576:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529875.012359:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529875.012365:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 51 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.012382:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 51 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.012403:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529875.012421:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.012431:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.012439:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.012459:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529875.012602:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+51:2355:x1875409158328576:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 258us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529875.012611:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00010000:00010000:0.0:1788529875.016313:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef8 expref: 50 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529875.016344:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185616384:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529875.016370:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.016380:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.016387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529875.016408:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788529875.016695:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b779 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.016712:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.016721:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529875.016724:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788529875.016728:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfe00, rc 0) 00000100:00100000:0.0:1788529875.016861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+50:10579:x1875409158328448:12345-192.168.201.52@tcp:101:bash.0 Request processed in 14882us (18835us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788529875.016870:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:1.0:1788529875.023229:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.023315:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158328832 00000100:00100000:3.0:1788529875.023325:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158328832 00000100:00100000:3.0:1788529875.023384:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1788529875.023396:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:10579:x1875409158328832:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:3.0:1788529875.025953:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.025977:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.025990:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788529875.026050:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788529875.026078:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025db09e1 reply state 000000006d90ce35 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529875.026088:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529875.026943:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+53:10579:x1875409158328832:12345-192.168.201.52@tcp:36:bash.0 Request processed in 3543us (3719us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788529875.026953:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000020:00080000:2.0:1788529875.026958:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788529875.029685:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029704:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029725:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029731:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529875.029736:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029745:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029760:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529875.029764:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529875.029769:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.029775:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b78e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529875.033230:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.033472:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158328960 00000100:00100000:0.0:1788529875.033483:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158328960 00000100:00100000:0.0:1788529875.033558:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:0.0:1788529875.033569:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10579:x1875409158328960:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529875.033595:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529875.033617:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f06 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.033699:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.033714:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.033738:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.033776:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.033795:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 53 pid: 5831 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529875.033810:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185616512:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529875.033945:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529875.045631:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.045731:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329088 00000100:00100000:3.0:1788529875.045742:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329088 00010000:00010000:3.0:1788529875.045786:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 54 pid: 5831 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529875.045830:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1788529875.045840:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:2354:x1875409158329088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529875.045855:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529875.045863:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 54 pid: 5831 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.045880:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 54 pid: 5831 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.045955:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529875.045962:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.045974:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.045982:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.046005:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529875.046058:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:2354:x1875409158329088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 219us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529875.046067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00010000:00010000:0.0:1788529875.048806:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b780 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eff expref: 53 pid: 5831 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529875.048834:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185616512:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529875.048859:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.048869:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.048875:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529875.049031:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788529875.049036:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529875.049058:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.049132:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.049148:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.049158:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529875.049161:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529875.049165:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df600, rc 0) 00000100:00100000:0.0:1788529875.049234:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10579:x1875409158328960:12345-192.168.201.52@tcp:101:bash.0 Request processed in 15666us (16018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529875.049244:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:2.0:1788529875.059615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.059801:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329344 00000100:00100000:0.0:1788529875.059815:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329344 00000100:00100000:0.0:1788529875.059978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1788529875.059990:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:10579:x1875409158329344:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1788529875.060256:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+53:10579:x1875409158329344:12345-192.168.201.52@tcp:35:bash.0 Request processed in 267us (654us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788529875.060264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1788529875.153308:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529875.153465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329472 00000100:00100000:1.0:1788529875.153475:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329472 00000100:00100000:1.0:1788529875.153531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:1.0:1788529875.153538:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+53:10585:x1875409158329472:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529875.153571:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529875.153588:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b7a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f0d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153645:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153672:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529875.153705:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788529875.153709:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529875.153727:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153750:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b7a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f0d expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153768:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f0d expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.153776:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529875.153779:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529875.153782:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529875.153873:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158329472:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 335us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529875.153878:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:2.0:1788529875.157847:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.157946:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329600 00000100:00100000:0.0:1788529875.157956:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329600 00000100:00100000:1.0:1788529875.158141:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1788529875.158155:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158329600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529875.158177:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529875.158197:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b7b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f14 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158280:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158308:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158329:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158337:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158344:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158441:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158450:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158457:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529875.158501:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788529875.158514:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529875.158534:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158545:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158553:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158559:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158565:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158570:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529875.158574:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158581:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158591:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788529875.158593:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529875.158598:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158603:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b7b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158627:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158633:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158638:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158643:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529875.158646:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158652:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158659:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc3837100) 00010000:00010000:1.0:1788529875.158662:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529875.158665:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158671:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18b7bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158847:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18b7b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158861:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.158877:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529875.158879:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529875.158882:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529875.159159:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:10585:x1875409158329600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1007us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529875.159166:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:3.0:1788529875.165699:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.165937:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529875.166049:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329984 00000100:00100000:1.0:1788529875.166060:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329984 00000100:00100000:1.0:1788529875.166120:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1788529875.166139:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:10585:x1875409158329984:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529875.166161:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529875.166182:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f1b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166286:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166302:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166312:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166321:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166370:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166396:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529875.166411:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185616640:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529875.166507:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.166516:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529875.166525:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc881c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185616768:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529875.166549:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee000 going to sleep for 11 seconds 00000100:00100000:2.0:1788529875.167825:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158329728 00000100:00100000:2.0:1788529875.167834:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158329728 00010000:00010000:2.0:1788529875.167872:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 57 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529875.167947:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1788529875.167957:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:2355:x1875409158329728:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529875.167969:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529875.167988:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 57 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529875.168259:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 57 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529875.168282:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529875.168286:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529875.168295:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529875.168303:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529875.168417:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:2355:x1875409158329728:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 460us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529875.168425:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00010000:00010000:1.0:1788529875.172643:0:5829:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.52@tcp) returned -22 from blocking AST (req@0000000074cd4607 x1875409185616640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.172667:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b7c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f14 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529875.172684:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185616640:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529875.175765:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc881c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185616768:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529875.175800:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529875.175806:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.175838:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.175847:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529875.195725:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.196011:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330112 00000100:00100000:3.0:1788529875.196020:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330112 00010000:00010000:3.0:1788529875.196064:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529875.196114:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:3.0:1788529875.196133:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+56:2354:x1875409158330112:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529875.196149:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529875.196156:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196175:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196198:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b79c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f06 expref: 56 pid: 5830 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196215:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529875.196221:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196230:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196238:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529875.196273:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529875.196331:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:2354:x1875409158330112:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 206us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529875.196352:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00010000:00010000:0.0:1788529875.196538:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.196548:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529875.196577:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788529875.196752:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.196768:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.196776:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529875.196779:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788529875.196782:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48400, rc 0) 00000100:00100000:0.0:1788529875.196809:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:10585:x1875409158329984:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 30673us (30918us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788529875.196817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:0.0:1788529875.203456:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529875.203551:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330368 00000100:00100000:1.0:1788529875.203561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330368 00000100:00100000:1.0:1788529875.203627:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1788529875.203637:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:10585:x1875409158330368:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:1.0:1788529875.203652:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529875.203675:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b733 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ef1 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529875.203693:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529875.203699:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529875.203755:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158330368:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 120us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529875.203762:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1788529875.209078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.213690:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330496 00000100:00100000:0.0:1788529875.213707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330496 00000100:00100000:0.0:1788529875.213834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1788529875.213846:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158330496:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:0.0:1788529875.213998:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.214029:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.214042:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529875.214404:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788529875.214517:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158330496:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 673us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529875.214526:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:3.0:1788529875.220375:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.228924:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.228963:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330880 00000100:00100000:3.0:1788529875.228974:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330880 00000100:00100000:3.0:1788529875.229055:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:3.0:1788529875.229066:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158330880:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529875.229145:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158330880:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529875.229153:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00080000:3.0:1788529875.229176:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529875.229213:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529875.229299:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529875.230113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330624 00000100:00100000:0.0:1788529875.230503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330624 00000100:00100000:0.0:1788529875.230575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:0.0:1788529875.230583:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:10585:x1875409158330624:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529875.230600:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529875.230620:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f22 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.230672:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.230683:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.230702:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.231153:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.231170:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:0.0:1788529875.231173:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529875.231177:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529875.231184:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df000, rc 0) 00000100:00100000:0.0:1788529875.231254:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+55:10585:x1875409158330624:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 671us (10890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529875.231262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:2.0:1788529875.231743:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158330752 00000100:00100000:2.0:1788529875.231750:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158330752 00000100:00100000:2.0:1788529875.231786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 327 00000100:00100000:2.0:1788529875.231794:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158330752:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529875.231827:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158330752:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 34us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529875.231834:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 327 00000100:00100000:0.0:1788529875.242223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331008 00000100:00100000:0.0:1788529875.242238:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331008 00000100:00100000:0.0:1788529875.242327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:0.0:1788529875.242340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158331008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529875.242429:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158331008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 92us (13129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529875.242436:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00080000:3.0:1788529875.242608:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788529875.277547:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529876.109489:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529876.109498:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529876.109540:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788529876.109562:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529876.109685:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5c1ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185616896:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788529876.110163:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529876.116995:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5c1ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185616896:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788529876.118495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.118647:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331136 00000100:00100000:2.0:1788529876.118657:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331136 00000100:00100000:2.0:1788529876.118724:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:2.0:1788529876.118734:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:10586:x1875409158331136:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788529876.118764:0:5830:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788529876.118866:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:10586:x1875409158331136:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.118882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1788529876.124152:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.124410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331264 00000100:00100000:2.0:1788529876.124420:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331264 00000100:00100000:2.0:1788529876.124480:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:2.0:1788529876.124491:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:10586:x1875409158331264:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.124565:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.124583:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.124597:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.124661:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.124688:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.124695:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125320:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125331:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125340:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529876.125381:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788529876.125385:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529876.125398:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125410:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125416:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125423:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125430:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.125434:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125451:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125464:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:2.0:1788529876.125467:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529876.125473:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125479:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18b7f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125494:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125501:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125507:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125511:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.125514:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125521:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125528:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cabc8c54f00) 00010000:00010000:2.0:1788529876.125531:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529876.125534:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125551:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b7f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125569:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125575:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125581:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125586:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.125589:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125595:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125604:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529876.125606:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529876.125609:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.125615:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.126492:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:10586:x1875409158331264:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 1996us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.126503:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1788529876.146161:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.146297:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331520 00000100:00100000:2.0:1788529876.146308:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331520 00000100:00100000:2.0:1788529876.146371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:2.0:1788529876.146382:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:10586:x1875409158331520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.146404:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529876.146425:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b805 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146524:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146539:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146551:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529876.146562:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788529876.146665:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146673:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146680:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146686:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.146690:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146708:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146733:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529876.146736:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788529876.146741:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146747:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b80c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146789:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b805 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f29 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146800:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:2.0:1788529876.146802:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788529876.146806:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b805 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f29 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.146816:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100000, rc 0) 00000100:00100000:2.0:1788529876.146886:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158331520:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 496us (724us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788529876.146932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:0.0:1788529876.153592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.153678:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331648 00000100:00100000:1.0:1788529876.153688:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331648 00000100:00100000:1.0:1788529876.153752:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:1.0:1788529876.153762:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158331648:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788529876.153796:0:7603:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788529876.154321:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158331648:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 192us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.154332:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:3.0:1788529876.161124:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.161270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158331904 00000100:00100000:0.0:1788529876.161287:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158331904 00000100:00100000:0.0:1788529876.161370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:0.0:1788529876.161381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158331904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529876.161402:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529876.161405:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788529876.161432:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b7aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f0d expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.161456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788529876.161461:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529876.161478:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b81a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f30 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788529876.161987:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788529876.162216:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.162232:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.162244:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.162299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b81a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f30 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.162315:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f30 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.162321:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09800) 00010000:00010000:0.0:1788529876.162324:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529876.162326:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529876.162402:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:10586:x1875409158331904:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1023us (1305us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788529876.162410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:0.0:1788529876.168056:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.168138:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158332160 00000100:00100000:2.0:1788529876.168149:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158332160 00000100:00100000:2.0:1788529876.168213:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1788529876.168225:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+57:10586:x1875409158332160:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.168283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529876.168313:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f30 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168351:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09800) 00010000:00010000:2.0:1788529876.168363:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529876.168385:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168401:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168412:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168425:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168432:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168438:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168503:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168512:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168519:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168526:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.168531:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168545:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168555:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529876.168558:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529876.168562:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168568:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18b82f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168580:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168587:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168593:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168599:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.168602:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168609:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168616:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9e4ecf6a (ffff8cabc8c54f00) 00010000:00010000:2.0:1788529876.168619:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529876.168622:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.168636:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b836 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9e4ecf6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.168735:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158332160:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 511us (687us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788529876.168743:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:3.0:1788529876.182328:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.182446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158332288 00000100:00100000:0.0:1788529876.182463:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158332288 00000100:00100000:0.0:1788529876.182546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:0.0:1788529876.182558:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+56:10586:x1875409158332288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529876.182596:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529876.182623:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b83d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f37 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182657:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182671:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182683:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182788:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b83d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182806:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.182815:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:0.0:1788529876.182818:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788529876.182822:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df600, rc 0) 00000100:00100000:0.0:1788529876.183368:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:10586:x1875409158332288:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 809us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529876.183375:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:2.0:1788529876.193212:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.193284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158332544 00000100:00100000:3.0:1788529876.193295:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158332544 00000100:00100000:3.0:1788529876.193356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:3.0:1788529876.193365:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+57:10586:x1875409158332544:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529876.193448:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.193466:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.193508:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529876.193764:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788529876.193774:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386163879734ns, next at 387163877246ns, rc = 0 00000004:00010000:3.0:1788529876.193866:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a2bfd8d reply state 00000000cccbd731 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.193886:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529876.194028:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+59:10586:x1875409158332544:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 662us (824us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788529876.194035:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00010000:00010000:3.0:1788529876.197521:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197540:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197547:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197553:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529876.197559:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197567:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197584:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:3.0:1788529876.197587:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788529876.197608:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.197615:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b84b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.220384:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.220882:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158332672 00000100:00100000:1.0:1788529876.220943:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158332672 00000100:00100000:1.0:1788529876.221006:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:1.0:1788529876.221017:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:10586:x1875409158332672:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529876.221044:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529876.221064:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f3e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.221128:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.221143:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.221163:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:1.0:1788529876.221166:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788529876.221170:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49800, rc 0) 00000100:00100000:1.0:1788529876.221241:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:10586:x1875409158332672:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 226us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.221248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:1.0:1788529876.233164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.233326:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158332800 00000100:00100000:0.0:1788529876.233337:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158332800 00000100:00100000:0.0:1788529876.233398:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:0.0:1788529876.233410:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158332800:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788529876.233739:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158332800:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 330us (583us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788529876.233748:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1788529876.237224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.237451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333056 00000100:00100000:3.0:1788529876.237465:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333056 00000100:00100000:3.0:1788529876.237567:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1788529876.237581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+59:10586:x1875409158333056:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788529876.238167:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:10586:x1875409158333056:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 586us (959us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788529876.238178:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1788529876.254087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.255850:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333312 00000100:00100000:3.0:1788529876.255868:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333312 00000100:00100000:2.0:1788529876.260476:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:2.0:1788529876.260514:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:10586:x1875409158333312:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788529876.260711:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:10586:x1875409158333312:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 209us (6638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.260720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:1.0:1788529876.276977:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.277217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333440 00000100:00100000:2.0:1788529876.277232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333440 00000100:00100000:2.0:1788529876.277321:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:2.0:1788529876.277334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+60:10586:x1875409158333440:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.277367:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529876.277397:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f45 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.277755:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.277786:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.277801:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529876.277850:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529876.277885:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.278071:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f45 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.278094:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f45 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.278104:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:2.0:1788529876.278107:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788529876.278112:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101c00, rc 0) 00000100:00100000:2.0:1788529876.278322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+61:10586:x1875409158333440:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 989us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.278331:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:3.0:1788529876.282637:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.282826:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333568 00000100:00100000:1.0:1788529876.282840:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333568 00000100:00100000:1.0:1788529876.282997:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1788529876.283009:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:2354:x1875409158333568:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529876.283034:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529876.283063:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f4c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529876.283097:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9accd4, blocks: 0x1 00010000:00010000:1.0:1788529876.283136:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1788529876.283143:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529876.283155:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.283179:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.283208:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529876.283289:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+10:2354:x1875409158333568:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 282us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.283297:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1788529876.286627:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.286797:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333824 00000100:00100000:2.0:1788529876.286812:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333824 00000100:00100000:2.0:1788529876.286949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1788529876.286962:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+61:10586:x1875409158333824:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788529876.287127:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+61:10586:x1875409158333824:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 166us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.287154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1788529876.291717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.294632:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158333952 00000100:00100000:3.0:1788529876.294653:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158333952 00000100:00100000:3.0:1788529876.294756:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1788529876.294768:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+10:10586:x1875409158333952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529876.294793:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529876.294822:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f53 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.294862:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.295172:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529876.295179:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529876.295187:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.305041:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529876.308322:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.308362:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.308386:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5c1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185617024:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529876.309165:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788529876.338526:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5c1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185617024:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529876.338591:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.338619:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:2.0:1788529876.338716:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+11:10586:x1875409158333952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 43938us (47003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.338728:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1788529876.340335:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.341889:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334080 00000100:00100000:3.0:1788529876.341958:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334080 00010000:00010000:3.0:1788529876.342024:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.342070:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1788529876.342081:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+11:2355:x1875409158334080:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529876.342112:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529876.342146:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.342168:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.342316:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c838522/0xaa46022e3f18b867 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f4c expref: 11 pid: 6689 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.342340:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529876.342362:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529876.342374:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.342386:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.342439:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.342458:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185617152:192.168.201.52@tcp:105: 00000100:00100000:3.0:1788529876.343466:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7d63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529876.353208:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.353253:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334208 00000100:00100000:0.0:1788529876.353266:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334208 00002000:00100000:0.0:1788529876.353340:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cabf569ea00 x1875409158334208/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:572/0 lens 504/0 e 0 to 0 dl 1788529887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529876.353353:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf569ea00 with x1875409158334208 ext(0->12) 00002000:00010000:0.0:1788529876.353361:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabf569ea00 00000100:00100000:0.0:1788529876.353393:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1788529876.353405:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+11:2354:x1875409158334208:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788529876.353746:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185617152:192.168.201.52@tcp:105: 00010000:00010000:3.0:1788529876.353776:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529876.353841:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+11:2355:x1875409158334080:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 11762us (13517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529876.353851:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1788529876.355514:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+12:2354:x1875409158334208:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 2101us (2326us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788529876.355527:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:0.0:1788529876.355539:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cabf569ea00 x1875409158334208/t4294967308(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:572/0 lens 504/448 e 0 to 0 dl 1788529887 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529876.355559:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf569ea00 with x1875409158334208 ext(0->12) 00002000:00010000:0.0:1788529876.355566:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabf569ea00 00000100:00100000:3.0:1788529876.362335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.362508:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334336 00000100:00100000:0.0:1788529876.362521:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334336 00000100:00100000:0.0:1788529876.362617:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:0.0:1788529876.362632:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+61:10586:x1875409158334336:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788529876.447723:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:3.0:1788529876.447766:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabf5f72a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788529876.447773:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc3440d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf5f72480 00000020:00080000:3.0:1788529876.447777:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc3440300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc8978c00 00000004:00080000:3.0:1788529876.447831:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788529876.447878:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788529876.447997:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000020:00080000:3.0:1788529876.448044:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1788529876.448082:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788529876.448180:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788529876.448192:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1788529876.448231:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788529876.448249:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabf56e5f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788529876.448252:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabfccb4a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf56e5900 00000020:00080000:3.0:1788529876.448255:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabfccb4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc8973c00 00000100:00100000:3.0:1788529876.448455:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185617280:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788529876.448568:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788529876.448796:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788529876.449078:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529876.449349:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185617280 00000100:00100000:2.0:1788529876.449360:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185617280 00000100:00100000:2.0:1788529876.449451:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788529876.449463:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875409185617280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788529876.449514:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788529876.450217:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9accd2, atime: 0x6a9accd2, ctime: 0x6a9accd2, blocks: 0x1 00010000:00010000:2.0:1788529876.450227:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.450249:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788529876.450255:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529876.450263:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.450282:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.450296:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.450304:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.450327:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788529876.451372:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185617536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788529876.452044:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+15:10586:x1875409158334336:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 89408us (89717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529876.452070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1788529876.452412:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529876.452426:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185617408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788529876.452481:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788529876.452577:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529876.452962:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788529876.452974:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788529876.453370:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185617408 00000100:00100000:3.0:1788529876.453382:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185617408 00000100:00080000:3.0:1788529876.453453:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788529876.453709:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788529876.453722:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875409185617408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788529876.453762:0:12086:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788529876.453795:0:12086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.453833:0:12086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.453844:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788529876.453849:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529876.453854:0:12086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.453974:0:12086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.453999:0:12086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 11 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529876.454016:0:12086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12086:1875409185617664:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529876.457008:0:12086:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72900 going to sleep for 11 seconds 00010000:00010000:3.0:1788529876.461088:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529876.461128:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.461149:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529876.461157:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.461172:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.461205:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.461247:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050297207/0xaa46022e3f18b875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.461288:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529876.461290:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529876.461293:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529876.463479:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.463532:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788529876.463555:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788529876.463771:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334592 00000100:00100000:3.0:1788529876.463784:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334592 00000100:00100000:3.0:1788529876.463988:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1788529876.464001:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+12:2356:x1875409158334592:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788529876.467417:0:12086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12086:1875409185617664:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529876.467462:0:12086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.472637:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875409185617280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23160us (23543us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788529876.472657:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788529876.475454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529876.475779:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185617536 00000100:00100000:2.0:1788529876.475793:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185617536 00000100:00100000:2.0:1788529876.475939:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788529876.475952:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185617536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788529876.476746:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788529876.476752:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788529876 00002000:00010000:2.0:1788529876.476755:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788529876.476757:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788529876 -> 1788529876 00002000:00010000:2.0:1788529876.476759:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788529876.476861:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1875409185617536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 909us (1415us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788529876.476882:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1788529876.477338:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabc3f70380/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788529876.477348:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185617536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788529876.480280:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabfcb23100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788529876.480301:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185617280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788529876.481698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.492829:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334464 00000100:00100000:1.0:1788529876.492851:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334464 00010000:00010000:1.0:1788529876.492970:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.493025:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1788529876.493038:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5075c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:2355:x1875409158334464:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529876.493058:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529876.493065:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493087:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493127:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c68a8a84/0xaa46022e3f18b637 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0eb2 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493147:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529876.493152:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529876.493160:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493171:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493639:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529876.493738:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5075c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+12:2355:x1875409158334464:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 700us (12046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.493763:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00010000:00010000:1.0:1788529876.493846:0:12086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493857:0:12086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493880:0:12086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493889:0:12086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.493928:0:12086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788529876.496795:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875409185617408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43066us (44302us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788529876.496811:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788529876.497043:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529876.497054:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.497070:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529876.497075:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.497088:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788529876.497477:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabc3f73100/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788529876.497487:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185617408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788529876.498833:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.498843:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bb49505/0xaa46022e3f18b87c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.498888:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529876.498891:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529876.498917:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529876.560783:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529876.560817:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185617792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529876.560958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529876.565607:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185617792 00000100:00100000:2.0:1788529876.565630:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185617792 00000100:00100000:2.0:1788529876.565747:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788529876.565761:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185617792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788529876.565816:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529876.565985:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185617792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (5027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.565994:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788529876.566067:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185617792:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788529876.568635:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788529876.568683:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788529876.568987:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158334592:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 104978us (105511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529876.569001:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1788529876.576776:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.577418:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334848 00000100:00100000:2.0:1788529876.577434:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334848 00000100:00100000:2.0:1788529876.577541:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:2.0:1788529876.577557:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+15:10586:x1875409158334848:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.577635:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529876.577691:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f45 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.577717:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:2.0:1788529876.577725:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529876.577768:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.577785:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.577798:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529876.578406:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c81c8db reply state 00000000f748f9f3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.578418:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529876.578719:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+16:10586:x1875409158334848:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1164us (1956us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788529876.578728:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:2.0:1788529876.582576:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:0.0:1788529876.582691:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582707:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582715:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582722:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529876.582728:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582738:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582761:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:0.0:1788529876.582764:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529876.582771:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.582778:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b883 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.583498:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158334976 00000100:00100000:3.0:1788529876.583516:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158334976 00000100:00100000:3.0:1788529876.583591:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1788529876.583603:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158334976:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788529876.583936:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788529876.583940:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788529876 -> 1788529875 00002000:00010000:3.0:1788529876.583942:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788529874 00002000:00010000:3.0:1788529876.583956:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788529876 -> 1788529875 00002000:00010000:3.0:1788529876.583959:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788529876.584037:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158334976:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 436us (1479us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788529876.584046:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1788529876.587322:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.587600:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158335232 00000100:00100000:2.0:1788529876.587613:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158335232 00000100:00100000:2.0:1788529876.587725:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:2.0:1788529876.587737:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+15:10586:x1875409158335232:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788529876.587832:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.587853:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.587922:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.587987:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.588010:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 15 pid: 5831 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.588030:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5c1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185617920:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529876.588171:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2891240 going to sleep for 11 seconds 00000100:00100000:3.0:1788529876.596361:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.596655:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158335360 00000100:00100000:1.0:1788529876.596668:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158335360 00010000:00010000:1.0:1788529876.596724:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 16 pid: 5831 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.596767:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:1.0:1788529876.596779:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+16:2355:x1875409158335360:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529876.596799:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529876.596807:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 16 pid: 5831 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.596828:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 16 pid: 5831 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.596949:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:1.0:1788529876.596957:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.596969:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.596978:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.597003:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529876.597076:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+16:2355:x1875409158335360:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 298us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.597084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00010000:00010000:2.0:1788529876.597555:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f37 expref: 15 pid: 5831 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.597576:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5c1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185617920:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529876.597604:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597615:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597622:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597664:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597671:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597688:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597695:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529876.597700:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597709:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597721:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:2.0:1788529876.597724:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788529876.597728:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.597735:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b88a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.597797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:10586:x1875409158335232:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 10062us (10495us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788529876.597808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:3.0:1788529876.604170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.604561:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158335488 00000100:00100000:0.0:1788529876.604575:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158335488 00000100:00100000:0.0:1788529876.604656:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1788529876.604669:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158335488:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788529876.604731:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.604759:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.604770:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529876.604775:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529876.604780:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.604827:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529876.604851:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 7 pid: 6687 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529876.605321:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875409185618048:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529876.605492:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529876.613851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.614001:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158335616 00000100:00100000:1.0:1788529876.614016:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158335616 00010000:00010000:1.0:1788529876.614076:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 8 pid: 6687 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.614301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1788529876.614315:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158335616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529876.614337:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529876.614370:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 8 pid: 6687 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.614393:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 8 pid: 6687 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.614449:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529876.614456:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529876.614465:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.614477:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.614520:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529876.614609:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158335616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 296us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529876.614617:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00010000:00010000:3.0:1788529876.616221:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002366d074/0xaa46022e3f18b86e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f53 expref: 7 pid: 6687 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.616249:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875409185618048:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529876.616280:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616292:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616299:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616340:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616351:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616382:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616390:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529876.616395:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616405:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616425:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.616433:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edd6cf9/0xaa46022e3f18b891 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.616548:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158335488:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 11873us (12385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529876.616558:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1788529876.628682:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.628863:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158335872 00000100:00100000:1.0:1788529876.628889:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158335872 00000100:00100000:1.0:1788529876.629044:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1788529876.629059:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+14:10586:x1875409158335872:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788529876.629205:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629231:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629245:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629528:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629764:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629773:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629817:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.629840:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 15 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.629858:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185618176:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529876.630024:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529876.633972:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.638393:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158336000 00000100:00100000:3.0:1788529876.638414:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158336000 00010000:00010000:3.0:1788529876.638481:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 16 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529876.638555:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1788529876.638586:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+16:2354:x1875409158336000:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529876.638610:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529876.638618:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 16 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.638640:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 16 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.638668:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:3.0:1788529876.638675:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.638687:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.638696:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.638720:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529876.638795:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+16:2354:x1875409158336000:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 212us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529876.638803:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00010000:00010000:1.0:1788529876.640048:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f3e expref: 15 pid: 5830 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.640072:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185618176:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529876.640118:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.640130:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.640136:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788529876.640411:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788529876.640777:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788529876.640834:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788529876.640995:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7603:1875409185618304:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788529876.641092:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529876.641143:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529876.642854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185618304 00000100:00100000:3.0:1788529876.642955:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185618304 00000100:00100000:3.0:1788529876.643036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788529876.643048:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7603:x1875409185618304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788529876.643348:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7603:x1875409185618304:12345-0@lo:1000:mdt00_003.0 Request processed in 301us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529876.643356:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788529876.643863:0:7603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788529876.643880:0:7603:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788529876.643930:0:7603:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cabc3f70380 x1875409185617536/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788529892 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529876.643946:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7603:1875409185618304:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788529876.649014:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788529876.649792:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7603:1875409185618432:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788529876.649941:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529876.649997:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f72d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529876.650258:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185618432 00000100:00100000:3.0:1788529876.650269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185618432 00000100:00100000:3.0:1788529876.650337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788529876.650348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7603:x1875409185618432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788529876.650818:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7603:x1875409185618432:12345-0@lo:1000:mdt00_003.0 Request processed in 469us (875us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788529876.650828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788529876.650981:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7603:1875409185618432:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788529876.651035:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651049:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651058:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651065:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529876.651071:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651080:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651114:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc5e09d00) 00010000:00010000:1.0:1788529876.651117:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788529876.651142:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651149:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b89f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651189:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651196:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651203:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651208:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529876.651211:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651217:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651225:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529876.651228:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788529876.651236:0:7603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651249:0:7603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651260:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.651311:0:7603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.651325:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185618560:192.168.201.52@tcp:105: 00000100:00100000:1.0:1788529876.651415:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd20f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529876.657529:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.657675:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158336128 00000100:00100000:2.0:1788529876.657689:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158336128 00000100:00100000:2.0:1788529876.657764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1788529876.657777:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:10585:x1875409158336128:12345-192.168.201.52@tcp:49:lfs.0 00000100:00100000:2.0:1788529876.657999:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:10585:x1875409158336128:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 223us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.658007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1788529876.658590:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3f72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185618560:192.168.201.52@tcp:105: 00010000:00010000:1.0:1788529876.658629:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658642:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18b7e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658683:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658702:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658716:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658728:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658736:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658743:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658761:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529876.658766:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658774:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658788:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529876.658791:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529876.658796:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658802:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18b8a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658813:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658820:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658826:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658831:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529876.658834:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658840:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658859:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529876.658861:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788529876.658876:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.658883:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529876.659166:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+18:10586:x1875409158335872:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 30110us (30498us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788529876.659177:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000020:00080000:1.0:1788529876.659182:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788529876.662240:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529876.662251:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529876.662814:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788529876.662828:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788529876.666516:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529876.666580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529876.666763:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158336384 00000100:00100000:0.0:1788529876.666779:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158336384 00000100:00100000:0.0:1788529876.666876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:0.0:1788529876.666889:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+18:10585:x1875409158336384:12345-192.168.201.52@tcp:58:lfs.0 00000040:00080000:0.0:1788529876.667462:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788529876.667727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158336640 00000100:00100000:1.0:1788529876.667733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158336640 00000100:00100000:1.0:1788529876.667780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1788529876.667788:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:10586:x1875409158336640:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788529876.668806:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+20:10585:x1875409158336384:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 1914us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529876.668818:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000004:00080000:1.0:1788529876.671017:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788529876.671328:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788529876.671425:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671448:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671463:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671474:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671507:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671513:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529876.671547:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788529876.671697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+20:10586:x1875409158336640:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 3903us (5109us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788529876.671709:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000020:00080000:1.0:1788529876.671715:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529876.672887:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529876.672944:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.672955:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529876.672960:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.672973:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.672993:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cabc3837200) 00010000:00010000:3.0:1788529876.672996:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788529876.673002:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.673009:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b8ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.673034:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529876.673037:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529876.673038:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529876.717482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.718332:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158336768 00000100:00100000:2.0:1788529876.718346:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158336768 00000100:00100000:2.0:1788529876.718648:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:2.0:1788529876.718663:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:10588:x1875409158336768:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529876.718701:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529876.718798:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b8b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f5a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718920:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718939:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718952:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718969:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718975:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.718982:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.723927:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.723979:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.723990:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.724049:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.724077:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 21 pid: 5829 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.724710:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5c1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185618688:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529876.724839:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2891240 going to sleep for 11 seconds 00000100:00100000:0.0:1788529876.730806:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529876.731385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337024 00000100:00100000:1.0:1788529876.731400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337024 00000100:00100000:1.0:1788529876.731495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1788529876.731507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+22:5597:x1875409158337024:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788529876.731850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+23:5597:x1875409158337024:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 344us (1058us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788529876.731859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1788529876.736236:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5c1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185618688:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529876.736284:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529876.750113:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529876.750292:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337152 00000100:00100000:2.0:1788529876.750308:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337152 00010000:00010000:2.0:1788529876.750368:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 23 pid: 5829 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529876.750425:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1788529876.750439:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:2355:x1875409158337152:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529876.750460:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529876.750499:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 23 pid: 5829 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750522:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 23 pid: 5829 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750774:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b7d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f1b expref: 23 pid: 5829 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750796:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529876.750802:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750813:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750821:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529876.750874:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529876.751020:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+22:2355:x1875409158337152:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 583us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529876.751028:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00010000:00010000:3.0:1788529876.751201:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751212:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529876.751273:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788529876.751279:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529876.751304:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751321:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751332:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751340:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751347:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751354:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529876.751359:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751369:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751379:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788529876.751383:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529876.751399:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751406:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18b8bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751422:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751429:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751434:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751440:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529876.751443:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751449:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751457:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cabc8c54200) 00010000:00010000:3.0:1788529876.751460:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529876.751463:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751469:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100c00/0xaa46022e3f18b8c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751527:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101c00/0xaa46022e3f18b8b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f5a expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751566:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f5a expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529876.751575:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529876.751578:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529876.751581:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100e00, rc 0) 00000100:00100000:3.0:1788529876.751616:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:10588:x1875409158336768:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 32957us (34151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529876.751623:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00010000:00010000:2.0:1788529877.325176:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788529877.725582:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788529877.725594:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788529877.725653:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788529877.725662:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788529877.725834:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185618816:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788529877.726017:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f69000 going to sleep for 11 seconds 00000100:00100000:1.0:1788529877.734291:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185618816:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788529877.748625:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529877.749657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337280 00000100:00100000:2.0:1788529877.749672:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337280 00000100:00100000:2.0:1788529877.749768:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:2.0:1788529877.749783:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+21:10599:x1875409158337280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788529877.749833:0:5831:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788529877.750033:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+21:10599:x1875409158337280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 254us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529877.750043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00080000:0.0:1788529877.751583:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529877.777398:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529877.787741:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337536 00000100:00100000:2.0:1788529877.787762:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337536 00000100:00100000:2.0:1788529877.788186:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:2.0:1788529877.788205:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+21:10599:x1875409158337536:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788529877.788244:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529877.788280:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f61 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.788439:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b8d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.788475:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.788490:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529877.788505:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788529877.790651:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f61 expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.790686:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f61 expref: 23 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.790698:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529877.790701:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529877.790725:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101000, rc 0) 00000100:00100000:2.0:1788529877.790911:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:10599:x1875409158337536:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 2687us (13507us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788529877.790922:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:1.0:1788529877.805334:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529877.805444:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529877.805485:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337920 00000100:00100000:1.0:1788529877.805497:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337920 00000100:00100000:1.0:1788529877.805587:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1788529877.805601:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+23:2354:x1875409158337920:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529877.805623:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529877.805663:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18b8d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f61 expref: 23 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529877.805684:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:1.0:1788529877.805692:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529877.805760:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+22:2354:x1875409158337920:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 162us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529877.805768:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1788529877.805974:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158337792 00000100:00100000:2.0:1788529877.805980:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158337792 00000100:00100000:2.0:1788529877.806018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:2.0:1788529877.806025:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+22:10599:x1875409158337792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788529877.806145:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806166:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806181:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806463:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806471:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806479:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806485:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529877.806491:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806501:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806529:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529877.806533:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788529877.806539:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529877.806546:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529877.806691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+23:10599:x1875409158337792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 665us (1372us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788529877.806700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00000040:00080000:2.0:1788529877.806922:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529877.806928:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529877.807391:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788529877.807400:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529877.814664:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529877.814787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338176 00000100:00100000:3.0:1788529877.814800:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338176 00000100:00100000:3.0:1788529877.814973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:3.0:1788529877.814994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+23:10599:x1875409158338176:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788529877.817359:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+24:10599:x1875409158338176:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 2358us (2698us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788529877.817373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000040:00080000:2.0:1788529877.958227:0:12125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529877.958241:0:12125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529877.958297:0:12125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788529877.958303:0:12125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529878.150889:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529878.150954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338432 00000100:00100000:2.0:1788529878.150965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338432 00000100:00100000:2.0:1788529878.151034:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:2.0:1788529878.151048:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+24:10612:x1875409158338432:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529878.151079:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529878.151108:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f68 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529878.151263:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529878.151284:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529878.151303:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529878.151318:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788529878.151481:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b8ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f68 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529878.151503:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f68 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529878.151723:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529878.151728:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788529878.151733:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100400, rc 0) 00000100:00100000:2.0:1788529878.151810:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+26:10612:x1875409158338432:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 765us (942us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788529878.151817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:3.0:1788529878.162661:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529878.162704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338560 00000100:00100000:3.0:1788529878.162717:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338560 00000100:00100000:3.0:1788529878.162781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:3.0:1788529878.162792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+26:10612:x1875409158338560:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1788529878.162928:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.162953:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.162975:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163011:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163019:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163027:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163033:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529878.163038:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163047:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163062:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:3.0:1788529878.163065:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529878.163083:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529878.163091:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529878.163178:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+26:10612:x1875409158338560:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 388us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529878.163186:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:2.0:1788529878.235043:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529878.235155:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338688 00000100:00100000:0.0:1788529878.235170:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338688 00000100:00100000:0.0:1788529878.235273:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1788529878.235306:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158338688:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1788529878.235333:0:12087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529878.235361:0:12087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c03726/0xaa46022e3f18b908 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f6f expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529878.235400:0:12087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9accd3, atime: 0x6a9accd2, ctime: 0x6a9accd3, blocks: 0xb 00010000:00010000:0.0:1788529878.235441:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788529878.235447:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529878.235459:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c03726/0xaa46022e3f18b908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f6f expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529878.235482:0:12087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090c03726/0xaa46022e3f18b908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f6f expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529878.235499:0:12087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfe00, rc 0) 00000100:00100000:0.0:1788529878.235587:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158338688:12345-192.168.201.52@tcp:101:cat.0 Request processed in 284us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529878.235595:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00080000:3.0:1788529878.235764:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529878.241408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529878.241637:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338816 00000100:00100000:0.0:1788529878.241652:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338816 00002000:00100000:0.0:1788529878.241733:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cabfce28e00 x1875409158338816/t0(0) o3->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:574/0 lens 488/0 e 0 to 0 dl 1788529889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529878.241746:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfce28e00 with x1875409158338816 ext(0->4095) 00002000:00010000:0.0:1788529878.241754:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfce28e00 00000100:00100000:0.0:1788529878.241791:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1788529878.241803:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2357:x1875409158338816:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:0.0:1788529878.242602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2357:x1875409158338816:12345-192.168.201.52@tcp:3:cat.0 Request processed in 792us (1201us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788529878.242614:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:0.0:1788529878.242622:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cabfce28e00 x1875409158338816/t0(0) o3->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:574/0 lens 488/4536 e 0 to 0 dl 1788529889 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529878.242632:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfce28e00 with x1875409158338816 ext(0->4095) 00002000:00010000:0.0:1788529878.242636:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfce28e00 00010000:00010000:1.0:1788529878.349174:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788529878.765316:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788529878.765353:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1788529879.373212:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529879.629324:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185618944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529879.629441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529879.629691:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185619328:0@lo:400:kworker.0 00000100:00100000:0.0:1788529879.629732:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529879.629775:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619328 00000100:00100000:0.0:1788529879.629785:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619328 00000100:00100000:0.0:1788529879.629881:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788529879.629917:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185619328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529879.629980:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185619328:12345-0@lo:400:kworker.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529879.629988:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1788529879.630014:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529879.630164:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185618944 00000100:00100000:1.0:1788529879.630170:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185618944 00000100:00100000:1.0:1788529879.630218:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788529879.630227:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1875409185618944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529879.630264:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529879.630304:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1875409185618944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529879.630310:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788529879.630570:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185619072:0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.630619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529879.630673:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.630703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529879.630755:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619200 00000100:00100000:2.0:1788529879.630760:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619200 00000100:00100000:2.0:1788529879.630791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788529879.630797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185619200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.630850:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185619200:12345-0@lo:400:kworker.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529879.630857:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788529879.631237:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185619328:0@lo:400:kworker.0 00000100:00100000:1.0:1788529879.631294:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185618944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529879.631311:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185619456:0@lo:400:kworker.0 00000100:00100000:1.0:1788529879.631344:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529879.631684:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619072 00000100:00100000:3.0:1788529879.631691:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619072 00000100:00100000:3.0:1788529879.631729:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788529879.631737:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185619072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529879.631782:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185619072:12345-0@lo:400:kworker.0 Request processed in 46us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529879.631790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1788529879.632314:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529879.633675:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619456 00000100:00100000:2.0:1788529879.633689:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619456 00000100:00100000:2.0:1788529879.633764:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788529879.633774:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185619456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.633919:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185619456:12345-0@lo:400:kworker.0 Request processed in 121us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529879.633927:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788529879.634003:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185619072:0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.634017:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185619584:0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.634068:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529879.634142:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788529879.634174:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788529879.634180:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788529879.634197:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabfcb23100, transno 4294967304 00000100:00100000:2.0:1788529879.634210:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185619456:0@lo:400:kworker.0 00000100:00080000:0.0:1788529879.634873:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529879.634925:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619584 00000100:00100000:0.0:1788529879.634931:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619584 00000100:00100000:0.0:1788529879.634992:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788529879.635002:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185619584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529879.635077:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185619584:12345-0@lo:400:kworker.0 Request processed in 77us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529879.635085:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788529879.635139:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac77cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185619584:0@lo:400:kworker.0 00000100:00080000:1.0:1788529879.635258:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529880.367617:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529880.367656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529880.367870:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529880.367921:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529880.367953:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529880.367999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339072 00000100:00100000:1.0:1788529880.368011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339072 00000100:00100000:1.0:1788529880.368208:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339456 00000100:00100000:1.0:1788529880.368212:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339456 00000100:00100000:1.0:1788529880.368242:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:1.0:1788529880.368253:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+26:2354:x1875409158339072:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529880.368291:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:2.0:1788529880.368300:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158339456:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529880.369334:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+26:2354:x1875409158339072:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1077us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529880.369346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00080000:1.0:1788529880.369385:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529880.369887:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158339456:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1586us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529880.369927:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:2.0:1788529880.370380:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339328 00000100:00100000:2.0:1788529880.370391:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339328 00000100:00100000:2.0:1788529880.370461:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339200 00000100:00100000:2.0:1788529880.370465:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339200 00000100:00100000:2.0:1788529880.370492:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:2.0:1788529880.370502:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158339328:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529880.370649:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158339328:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 148us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529880.370657:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:2.0:1788529880.370674:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:2.0:1788529880.370681:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158339200:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529880.370708:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158339200:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529880.370715:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00080000:1.0:1788529880.374678:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788529880.374691:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788529880.375812:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158338944 00000100:00100000:0.0:1788529880.375830:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158338944 00000100:00100000:0.0:1788529880.375921:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 329 00000100:00100000:0.0:1788529880.375935:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158338944:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529880.376054:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158338944:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 122us (8449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529880.376063:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 329 00010000:00010000:3.0:1788529880.401605:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529880.909139:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529880.909149:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529880.909179:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788529880.909185:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788529881.421203:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529881.678930:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185619712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529881.679027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529881.684117:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619712 00000100:00100000:1.0:1788529881.684140:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619712 00000100:00100000:1.0:1788529881.684227:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788529881.684240:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185619712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529881.684290:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529881.684401:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185619712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529881.684410:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788529881.684979:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529881.685049:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185619712:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788529881.783573:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:3.0:1788529881.783600:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabf56e7c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788529881.783607:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabf54daa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf56e7d80 00000020:00080000:3.0:1788529881.783611:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabf54da100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf5686000 00000001:00080000:3.0:1788529881.783643:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788529881.783658:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788529881.784283:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788529881.784543:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788529881.812434:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788529881.813151:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788529881.813172:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1788529882.446666:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529883.475324:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529884.025557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529884.025605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339584 00000100:00100000:0.0:1788529884.025617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339584 00000100:00100000:0.0:1788529884.025691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:0.0:1788529884.025702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:10264:x1875409158339584:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788529884.025846:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:10264:x1875409158339584:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 145us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529884.025854:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00080000:0.0:1788529884.025880:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529884.031730:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529884.032204:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339840 00000100:00100000:2.0:1788529884.032219:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339840 00000100:00100000:2.0:1788529884.032310:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1788529884.032321:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:10264:x1875409158339840:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788529884.032865:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:10264:x1875409158339840:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 544us (1150us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788529884.032875:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1788529884.391502:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529884.391574:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158339968 00000100:00100000:1.0:1788529884.391589:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158339968 00000100:00100000:1.0:1788529884.391757:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:1.0:1788529884.391772:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+5:11065:x1875409158339968:12345-192.168.201.52@tcp:101:lsof.0 00010000:00010000:1.0:1788529884.391801:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529884.391832:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b90f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f76 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392057:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392076:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392094:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529884.392138:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788529884.392142:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529884.392189:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392218:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18b90f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 7 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392239:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 6 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529884.392274:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:1.0:1788529884.392278:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529884.392283:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529884.392374:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+6:11065:x1875409158339968:12345-192.168.201.52@tcp:101:lsof.0 Request processed in 605us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529884.392383:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00080000:0.0:1788529884.396625:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529884.493281:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529884.750421:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529884.750457:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529884.750583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529884.750701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619840 00000100:00100000:1.0:1788529884.750712:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619840 00000100:00100000:1.0:1788529884.750847:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788529884.750857:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185619840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788529884.750925:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788529884.751260:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788529884.751397:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185619840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 540us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529884.751406:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788529884.751539:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788529884.751547:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabc3f70380, transno 4294967309 00000004:00080000:2.0:1788529884.751564:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabc3f73100, transno 4294967310 00000004:00080000:2.0:1788529884.751569:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788529884.751605:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529884.753853:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185619968:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529884.754066:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185620480:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529884.754125:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529884.754132:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529884.754189:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620480 00000100:00100000:2.0:1788529884.754198:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620480 00000100:00100000:2.0:1788529884.754271:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620096 00000100:00100000:2.0:1788529884.754275:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620096 00000100:00100000:2.0:1788529884.754299:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788529884.754308:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754596:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185620480:12345-0@lo:400:kworker.0 Request processed in 287us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529884.754618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788529884.754639:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788529884.754646:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185620096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754678:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185620096:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529884.754683:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788529884.754713:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185620352:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529884.754780:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529884.754786:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185620224:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.754808:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788529884.754842:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529884.754853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620224 00000100:00100000:2.0:1788529884.754857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620224 00000100:00100000:2.0:1788529884.754885:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788529884.754891:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.755058:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185620224:12345-0@lo:400:kworker.0 Request processed in 165us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529884.755064:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788529884.755082:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529884.755118:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185620224:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.755145:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788529884.755155:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788529884.755279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185619968 00000100:00100000:3.0:1788529884.755285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185619968 00000100:00100000:3.0:1788529884.755328:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788529884.755337:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185619968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529884.755392:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3302:x1875409185619968:12345-0@lo:400:kworker.0 Request processed in 56us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529884.755399:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788529884.755577:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185619968:0@lo:400:kworker.0 00000100:00100000:1.0:1788529884.755759:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620352 00000100:00100000:1.0:1788529884.755765:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620352 00000100:00100000:0.0:1788529884.755935:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788529884.755947:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185620352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529884.756006:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185620352:12345-0@lo:400:kworker.0 Request processed in 63us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529884.756013:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788529884.756162:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529884.756533:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185620352:0@lo:400:kworker.0 00000100:00100000:0.0:1788529885.486317:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529885.486371:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529885.486440:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529885.486495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529885.486536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529885.486573:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340352 00000100:00100000:0.0:1788529885.486587:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340352 00000100:00100000:0.0:1788529885.486659:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340480 00000100:00100000:0.0:1788529885.486663:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340480 00000100:00100000:0.0:1788529885.486692:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1788529885.486705:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158340352:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529885.486825:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158340352:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529885.486833:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1788529885.486855:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1788529885.486862:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158340480:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529885.486936:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158340480:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529885.486945:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1788529885.487256:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340224 00000100:00100000:1.0:1788529885.487262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340224 00000100:00100000:1.0:1788529885.487298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340608 00000100:00100000:1.0:1788529885.487301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340608 00000100:00100000:1.0:1788529885.487326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:1.0:1788529885.487334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+14:2356:x1875409158340224:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529885.487440:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:2.0:1788529885.487451:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2357:x1875409158340608:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529885.487585:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340096 00000100:00100000:3.0:1788529885.487591:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340096 00000100:00100000:3.0:1788529885.487626:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 331 00000100:00100000:3.0:1788529885.487633:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158340096:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:0.0:1788529885.490734:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529885.490750:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529885.493168:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+14:2356:x1875409158340224:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 5813us (6774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529885.493188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:2.0:1788529885.504154:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2357:x1875409158340608:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 16684us (17595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529885.504177:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:3.0:1788529885.506289:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158340096:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 18640us (19970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529885.506307:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 331 00010000:00010000:1.0:1788529885.521269:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529886.542779:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529886.797799:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529886.797836:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185620608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529886.797975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529886.799823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620608 00000100:00100000:1.0:1788529886.799840:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620608 00000100:00100000:1.0:1788529886.799953:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788529886.799966:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185620608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529886.800012:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529886.800452:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185620608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 488us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529886.800462:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788529886.800623:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529886.800686:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc2e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185620608:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788529886.879148:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788529886.879169:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788529886.880217:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788529886.880246:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788529887.567415:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788529888.371287:0:12332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:51:26 (1788529886) 00010000:00010000:1.0:1788529888.599225:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529889.613299:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529889.869876:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185621120:0@lo:400:kworker.0 00000100:00100000:0.0:1788529889.869997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529889.870088:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529889.870095:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185620992:0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.870387:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185621120 00000100:00100000:1.0:1788529889.870399:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185621120 00000100:00100000:1.0:1788529889.870479:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788529889.870490:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185621120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.870565:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185621120:12345-0@lo:400:kworker.0 Request processed in 76us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529889.870573:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788529889.870598:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529889.870747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529889.870804:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185621120:0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.870953:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620992 00000100:00100000:1.0:1788529889.870957:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620992 00000100:00100000:1.0:1788529889.871000:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788529889.871017:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185620992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.871078:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185620992:12345-0@lo:400:kworker.0 Request processed in 63us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529889.871085:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788529889.871111:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185620992:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.871382:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.871419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529889.871453:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185621376:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.871478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529889.871619:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788529889.871628:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185620736:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.872118:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529889.872219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620864 00000100:00100000:1.0:1788529889.872226:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620864 00000100:00100000:0.0:1788529889.872404:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185621376 00000100:00100000:0.0:1788529889.872420:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185621376 00000100:00100000:0.0:1788529889.872459:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788529889.872467:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185621376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529889.872534:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185621376:12345-0@lo:400:kworker.0 Request processed in 68us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529889.872541:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788529889.872565:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788529889.872571:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529889.872649:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185621504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529889.872679:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529889.872736:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185621504 00000100:00100000:0.0:1788529889.872740:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185621504 00000100:00100000:0.0:1788529889.872769:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788529889.872776:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185621504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529889.872809:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529889.872846:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185621504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529889.872852:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788529889.872919:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185621504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529889.873720:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185621248:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.873763:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529889.873807:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185621376:0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.874245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185621248 00000100:00100000:1.0:1788529889.874264:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185621248 00000100:00100000:1.0:1788529889.874322:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788529889.874333:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185620864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.874392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185620864:12345-0@lo:400:kworker.0 Request processed in 61us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529889.874399:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788529889.874415:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788529889.874422:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185621248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529889.874450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185621248:12345-0@lo:400:kworker.0 Request processed in 29us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529889.874456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1788529889.874479:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529889.882828:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185621248:0@lo:400:kworker.0 00000100:00100000:3.0:1788529889.882854:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185620864:0@lo:400:kworker.0 00000100:00100000:2.0:1788529889.888402:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185620736 00000100:00100000:2.0:1788529889.888425:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185620736 00000100:00100000:2.0:1788529889.888538:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788529889.888552:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185620736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529889.889314:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185620736:12345-0@lo:400:kworker.0 Request processed in 762us (17192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529889.889325:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788529889.901708:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185620736:0@lo:400:kworker.0 00000040:00080000:3.0:1788529890.126188:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788529890.126201:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788529890.126773:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788529890.126782:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788529890.362205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529890.362515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340864 00000100:00100000:1.0:1788529890.362529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340864 00000100:00100000:1.0:1788529890.362641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:1.0:1788529890.362658:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:11330:x1875409158340864:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529890.362689:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529890.362718:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b91d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f7d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788529890.362835:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788529890.362844:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.362864:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.362881:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.362929:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.362938:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.362946:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367368:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b932 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367398:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b932 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367414:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b932 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529890.367429:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788529890.367612:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367621:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367656:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367663:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529890.367668:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367678:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367695:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc9230f00) 00010000:00010000:1.0:1788529890.367698:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529890.367705:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367712:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18b924 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367730:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367736:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367744:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367750:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529890.367753:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367770:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367780:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cabc3837c00) 00010000:00010000:1.0:1788529890.367783:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529890.367786:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.367793:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18b92b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.368968:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18b91d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f7d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.368994:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b932 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f7d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.369004:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529890.369008:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529890.369011:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529890.369111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+15:11330:x1875409158340864:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 6456us (6935us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788529890.369123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:0.0:1788529890.385825:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529890.385886:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529890.386052:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341120 00000100:00100000:2.0:1788529890.386066:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341120 00000100:00100000:2.0:1788529890.386146:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:2.0:1788529890.386160:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+15:11330:x1875409158341120:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788529890.386313:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+15:11330:x1875409158341120:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 156us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529890.386341:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:1.0:1788529890.390528:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158340992 00000100:00100000:1.0:1788529890.390549:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158340992 00000100:00100000:1.0:1788529890.390691:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1788529890.390704:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+15:2357:x1875409158340992:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529890.390750:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529890.390782:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18b932 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f7d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529890.390807:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529890.390813:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529890.390958:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:2357:x1875409158340992:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 256us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529890.390967:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1788529890.585007:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529890.585054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529890.585072:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529890.585112:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529890.585148:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341632 00000100:00100000:0.0:1788529890.585174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341632 00000100:00100000:0.0:1788529890.585265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:0.0:1788529890.585277:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+6:2356:x1875409158341632:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529890.585372:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+6:2356:x1875409158341632:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529890.585381:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00080000:0.0:1788529890.585408:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529890.585423:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341504 00000100:00100000:0.0:1788529890.585426:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341504 00000100:00100000:0.0:1788529890.585456:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341376 00000100:00100000:0.0:1788529890.585459:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341376 00000100:00100000:0.0:1788529890.585482:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1788529890.585488:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158341504:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529890.585527:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158341504:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529890.585534:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1788529890.585547:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1788529890.585553:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158341376:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529890.585580:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158341376:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529890.585587:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00080000:0.0:1788529890.585617:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529890.585619:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529890.585992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341248 00000100:00100000:3.0:1788529890.585998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341248 00000100:00100000:3.0:1788529890.586042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 333 00000100:00100000:3.0:1788529890.586050:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158341248:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529890.586084:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158341248:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 35us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529890.586090:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 333 00010000:00010000:2.0:1788529890.644743:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788529891.151787:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788529891.151798:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788529891.152403:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788529891.152413:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788529891.669832:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529891.920881:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529891.920932:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185621632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529891.921027:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529891.921114:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185621632 00000100:00100000:2.0:1788529891.921124:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185621632 00000100:00100000:2.0:1788529891.921193:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788529891.921203:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185621632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788529891.921246:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788529891.922062:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529891.923679:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185621632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2468us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529891.923695:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788529891.923801:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfce28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185621632:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788529891.996622:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788529892.685050:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529893.314457:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529893.317103:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158341760 00000100:00100000:1.0:1788529893.317126:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158341760 00000100:00100000:0.0:1788529893.317797:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:0.0:1788529893.317822:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+13:11373:x1875409158341760:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529893.317849:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529893.317885:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f84 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.317992:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318010:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318026:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318045:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318052:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318060:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318546:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318556:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318565:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318583:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529893.318589:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318608:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318624:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529893.318628:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529893.318634:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318642:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318657:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318664:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318670:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318676:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529893.318679:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318685:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318692:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529893.318695:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529893.318698:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318715:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b94e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318757:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b940 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f84 expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318770:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529893.318772:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529893.318776:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f84 expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.318786:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00000100:00080000:3.0:1788529893.319452:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529893.319959:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+13:11373:x1875409158341760:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2134us (5511us total) trans 0 rc 301/301 00000100:00100000:0.0:1788529893.319970:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:3.0:1788529893.332653:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.333044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342016 00000100:00100000:0.0:1788529893.333058:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342016 00000100:00100000:0.0:1788529893.333137:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:0.0:1788529893.333149:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+13:11373:x1875409158342016:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:0.0:1788529893.333240:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529893.333277:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b2be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dbd expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.333301:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529893.333308:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529893.333619:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.333643:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 5 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.333654:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.333698:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 5 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.333721:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 5 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.333741:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185621760:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529893.334311:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e83240 going to sleep for 11 seconds 00000100:00100000:3.0:1788529893.336650:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185621760:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529893.336687:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.339608:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.339814:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342144 00000100:00100000:0.0:1788529893.339828:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342144 00010000:00010000:0.0:1788529893.339916:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 6 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.339968:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:0.0:1788529893.339980:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc5074050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38bca45c-488d-404b-89e3-533f2a694da6+6:2355:x1875409158342144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529893.339999:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529893.340007:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 6 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340027:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 6 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340066:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18b916 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f76 expref: 6 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340085:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:0.0:1788529893.340092:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340104:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340112:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.340138:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529893.340211:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc5074050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158342144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 233us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.340219:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00080000:3.0:1788529893.340634:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788529893.340661:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.340671:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.340700:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.340711:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.340721:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529893.341987:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788529893.342006:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342016:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342024:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342030:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529893.342036:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342045:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342062:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230100) 00010000:00010000:3.0:1788529893.342073:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529893.342080:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.342087:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18b955 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529893.342113:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046bf1e63 reply state 00000000d1a31314 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.342123:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529893.342242:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+14:11373:x1875409158342016:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 9087us (9597us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788529893.342253:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00010000:00010000:3.0:1788529893.348509:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348531:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348540:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348547:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529893.348553:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348562:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348595:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cabc9230000) 00010000:00010000:3.0:1788529893.348599:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529893.348613:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.348620:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b95c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529893.485471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.486133:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342272 00000100:00100000:3.0:1788529893.486149:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342272 00000100:00100000:3.0:1788529893.486257:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:3.0:1788529893.486269:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+13:11381:x1875409158342272:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:3.0:1788529893.486303:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529893.486335:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f8b expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486428:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486445:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486458:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529893.486505:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788529893.486509:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529893.486535:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486565:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f8b expref: 15 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486624:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f8b expref: 14 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.486634:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:3.0:1788529893.486638:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529893.486643:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6e00, rc 0) 00000100:00100000:3.0:1788529893.486738:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+14:11381:x1875409158342272:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 471us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529893.486746:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:0.0:1788529893.553698:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.553934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342400 00000100:00100000:3.0:1788529893.553949:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342400 00000100:00100000:3.0:1788529893.554033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1788529893.554046:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+14:11387:x1875409158342400:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529893.554075:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529893.554106:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f92 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554213:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554237:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554254:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554275:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554303:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554312:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554442:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554452:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554459:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529893.554496:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788529893.554500:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529893.554523:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554538:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554545:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554552:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554559:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529893.554564:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554596:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554611:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:3.0:1788529893.554614:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529893.554620:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554628:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18b978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554644:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554651:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554658:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554664:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529893.554667:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554673:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554680:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cabc9230100) 00010000:00010000:3.0:1788529893.554682:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529893.554685:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554701:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b97f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554794:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f92 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554878:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f92 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.554887:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529893.554890:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788529893.554919:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7600, rc 0) 00000100:00100000:3.0:1788529893.555019:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+15:11387:x1875409158342400:12345-192.168.201.52@tcp:101:bash.0 Request processed in 973us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529893.555027:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1788529893.564302:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.564756:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342656 00000100:00100000:0.0:1788529893.564770:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342656 00000100:00100000:0.0:1788529893.564848:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:0.0:1788529893.564861:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+15:11387:x1875409158342656:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529893.564888:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529893.564957:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b98d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0f99 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.565147:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.565482:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.565501:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.568947:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.568981:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.568997:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788529893.569963:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788529893.570191:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570207:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570232:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570284:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570292:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570300:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570307:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529893.570312:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570320:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570336:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529893.570339:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529893.570344:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570350:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b994 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529893.570367:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007591e100 reply state 00000000c833a5a6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529893.570380:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788529893.570435:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18b98d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570451:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 17 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.570459:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:2.0:1788529893.570462:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529893.570464:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100800, rc 0) 00000100:00100000:2.0:1788529893.570589:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+18:11387:x1875409158342656:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5727us (6301us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788529893.570601:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00010000:00010000:0.0:1788529893.577025:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577044:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577052:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577059:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529893.577064:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577073:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577091:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529893.577094:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529893.577099:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.577106:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18b99b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.577137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529893.577594:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342784 00000100:00100000:1.0:1788529893.577608:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342784 00000100:00080000:3.0:1788529893.577775:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529893.577927:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1788529893.577943:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158342784:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529893.577970:0:12087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529893.577997:0:12087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fa0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529893.578032:0:12087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788529893.578059:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1788529893.578066:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529893.578077:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 6 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.578126:0:12087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 6 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.578144:0:12087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529893.578554:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158342784:12345-192.168.201.52@tcp:101:bash.0 Request processed in 615us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529893.578563:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1788529893.583695:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.583839:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158342912 00000100:00100000:0.0:1788529893.583867:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158342912 00000100:00100000:0.0:1788529893.583969:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1788529893.583981:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+6:11387:x1875409158342912:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529893.584003:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529893.584024:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fa7 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.584057:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.584067:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529893.584071:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529893.584077:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.584110:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.584129:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 7 pid: 12087 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.584144:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185621888:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529893.584259:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e83a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529893.595092:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.595365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158343040 00000100:00100000:3.0:1788529893.595385:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158343040 00010000:00010000:3.0:1788529893.595451:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 8 pid: 12087 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.595470:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875409185621888:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529893.595516:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.595524:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1788529893.595539:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158343040:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529893.595589:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de600, rc 0) 00010000:00010000:3.0:1788529893.595605:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529893.595658:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 8 pid: 12087 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.595677:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:11387:x1875409158342912:12345-192.168.201.52@tcp:101:bash.0 Request processed in 11688us (11982us total) trans 0 rc 0/0 00010000:00010000:3.0:1788529893.595683:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 8 pid: 12087 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.595700:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00010000:00010000:3.0:1788529893.595734:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c838522/0xaa46022e3f18b9b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa0 expref: 7 pid: 12087 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.595763:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529893.595771:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529893.595780:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.595791:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.596004:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.596021:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875409185622016:192.168.201.52@tcp:105: 00000100:00100000:3.0:1788529893.596115:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcbdaa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788529893.603372:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.603448:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875409185622016:192.168.201.52@tcp:105: 00010000:00010000:3.0:1788529893.603488:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529893.603581:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158343040:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 8035us (8490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529893.603619:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1788529893.606131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158343296 00000100:00100000:0.0:1788529893.606147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158343296 00000100:00100000:0.0:1788529893.606539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1788529893.606553:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+17:11387:x1875409158343296:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1788529893.606984:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+18:11387:x1875409158343296:12345-192.168.201.52@tcp:35:bash.0 Request processed in 432us (3622us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788529893.606992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1788529893.665016:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529893.665069:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529893.665159:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158343552 00000100:00100000:1.0:1788529893.665171:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158343552 00000100:00100000:1.0:1788529893.665239:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1788529893.665251:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158343552:12345-192.168.201.52@tcp:16:kworker.0 00000100:00100000:1.0:1788529893.665397:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158343552:12345-192.168.201.52@tcp:16:kworker.0 Request processed in 149us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529893.665405:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1788529893.671888:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158343424 00000100:00100000:3.0:1788529893.673050:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158343424 00002000:00100000:3.0:1788529893.673116:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cabf61e9180 x1875409158343424/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:589/0 lens 504/0 e 0 to 0 dl 1788529904 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529893.673127:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf61e9180 with x1875409158343424 ext(0->12) 00002000:00010000:3.0:1788529893.673133:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cabf61e9180 00000100:00100000:3.0:1788529893.673227:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1788529893.673238:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2357:x1875409158343424:12345-192.168.201.52@tcp:4:bash.0 00000100:00100000:3.0:1788529893.673991:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2357:x1875409158343424:12345-192.168.201.52@tcp:4:bash.0 Request processed in 751us (8917us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788529893.674000:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00002000:00100000:3.0:1788529893.674008:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cabf61e9180 x1875409158343424/t4294967305(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:589/0 lens 504/448 e 0 to 0 dl 1788529904 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529893.674017:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf61e9180 with x1875409158343424 ext(0->12) 00002000:00010000:3.0:1788529893.674021:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cabf61e9180 00010000:00010000:2.0:1788529893.718283:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529893.726288:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.726442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158343808 00000100:00100000:3.0:1788529893.726452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158343808 00000100:00100000:3.0:1788529893.726519:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:3.0:1788529893.726530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+18:11397:x1875409158343808:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529893.726553:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529893.726613:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529893.726740:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788529893.726856:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b9be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fae expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.726871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:3.0:1788529893.726874:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529893.726879:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fae expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.727058:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:3.0:1788529893.727114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:11397:x1875409158343808:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 585us (838us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788529893.727122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:1.0:1788529893.732920:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.735333:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344064 00000100:00100000:3.0:1788529893.735350:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344064 00000100:00100000:3.0:1788529893.735428:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1788529893.735438:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:11397:x1875409158344064:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529893.735739:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:11397:x1875409158344064:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 301us (2855us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788529893.735748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:1.0:1788529893.877834:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529893.877978:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344192 00000100:00100000:2.0:1788529893.877992:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344192 00000100:00100000:2.0:1788529893.878071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:2.0:1788529893.878093:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:11403:x1875409158344192:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529893.878131:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529893.878164:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18b9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fb5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878267:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878312:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878325:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529893.878372:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788529893.878376:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788529893.878397:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878429:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18b9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fb5 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878450:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fb5 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.878460:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529893.878463:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788529893.878468:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101200, rc 0) 00000100:00100000:2.0:1788529893.878548:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:11403:x1875409158344192:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 467us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529893.878556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:1.0:1788529893.884817:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.884999:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344448 00000100:00100000:0.0:1788529893.885012:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344448 00000100:00100000:0.0:1788529893.885107:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:0.0:1788529893.885120:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+21:11403:x1875409158344448:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529893.885150:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529893.885189:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b9da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fbc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.885330:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.885349:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.885363:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529893.885392:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788529893.885574:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18b9da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fbc expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.885600:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fbc expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.885611:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:0.0:1788529893.885615:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529893.885619:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df600, rc 0) 00000100:00100000:0.0:1788529893.885698:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+23:11403:x1875409158344448:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 580us (905us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788529893.885707:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:1.0:1788529893.893648:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529893.893801:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.894133:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344832 00000100:00100000:3.0:1788529893.894146:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344832 00000100:00100000:3.0:1788529893.894236:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:3.0:1788529893.894249:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:11403:x1875409158344832:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529893.894281:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529893.894328:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b9ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fc3 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.894459:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.894478:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.894493:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529893.894510:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788529893.894698:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18b9ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fc3 expref: 26 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.894721:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fc3 expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.894731:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:3.0:1788529893.894734:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788529893.894738:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529893.894829:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+25:11403:x1875409158344832:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 582us (1035us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788529893.894838:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:0.0:1788529893.900302:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344576 00000100:00100000:0.0:1788529893.900326:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344576 00000100:00100000:0.0:1788529893.900490:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1788529893.900504:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+25:2355:x1875409158344576:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529893.900524:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529893.900559:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18b9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fbc expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.900593:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:0.0:1788529893.900599:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529893.900687:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+24:2355:x1875409158344576:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 186us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.900695:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1788529893.903811:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.904031:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158344960 00000100:00100000:3.0:1788529893.904045:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158344960 00000100:00100000:3.0:1788529893.904125:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1788529893.904137:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:2356:x1875409158344960:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:3.0:1788529893.904234:0:12086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.904261:0:12086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.904271:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529893.904276:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788529893.904281:0:12086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.904327:0:12086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.904348:0:12086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 8 pid: 6688 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.904365:0:12086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12086:1875409185622144:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529893.904473:0:12086:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcbdaacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529893.909867:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.910045:0:12086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12086:1875409185622144:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529893.910096:0:12086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529893.910327:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158345088 00000100:00100000:2.0:1788529893.910338:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158345088 00010000:00010000:2.0:1788529893.910386:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 9 pid: 6688 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529893.910461:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:2.0:1788529893.910472:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158345088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529893.910491:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788529893.910516:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788529893.910519:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788529893 00002000:00010000:2.0:1788529893.910523:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788529893 00010000:00010000:2.0:1788529893.910531:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 9 pid: 6688 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.910551:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 9 pid: 6688 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.910594:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18b9b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fa7 expref: 9 pid: 6688 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.910615:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788529893.910621:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788529893.910627:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.910639:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.910676:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529893.910760:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158345088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 288us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529893.910769:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00010000:00010000:0.0:1788529893.910936:0:12086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.910948:0:12086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.910983:0:12086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.910994:0:12086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.911005:0:12086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.911014:0:12086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529893.911019:0:12086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.911031:0:12086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.911045:0:12086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.911054:0:12086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002366d074/0xaa46022e3f18ba04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.911137:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158344960:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 7002us (7346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.911148:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1788529893.916395:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529893.916549:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158345344 00000100:00100000:3.0:1788529893.916573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158345344 00000100:00100000:3.0:1788529893.916645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1788529893.916677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+24:11403:x1875409158345344:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:3.0:1788529893.916763:0:5832:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fc3 expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788529893.922010:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788529893.922126:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788529893.928357:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788529893.928522:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.928550:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.928561:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.928635:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529893.928666:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 28 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529893.928693:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf61e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875409185622272:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529893.928818:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529893.936532:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.936652:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158345472 00000100:00100000:0.0:1788529893.936666:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158345472 00010000:00010000:0.0:1788529893.936720:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 29 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529893.936775:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1788529893.936787:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+29:2354:x1875409158345472:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529893.936808:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529893.936816:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 29 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.936838:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 29 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.936866:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:0.0:1788529893.936873:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.936886:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.936922:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.936962:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529893.937032:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+29:2354:x1875409158345472:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 246us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.937040:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00010000:00010000:3.0:1788529893.937214:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18b9a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f99 expref: 28 pid: 7603 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529893.937235:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf61e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875409185622272:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529893.937267:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.937278:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529893.937284:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788529893.937456:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788529893.937747:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788529893.937879:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185622400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788529893.937982:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529893.938020:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529893.938219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185622400 00000100:00100000:0.0:1788529893.938226:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185622400 00000100:00100000:0.0:1788529893.938293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788529893.938302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875409185622400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788529893.938385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875409185622400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.938393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788529893.940118:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529893.940207:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185622400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788529893.940828:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788529893.940971:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185622528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788529893.941058:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529893.941089:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529893.941425:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185622528 00000100:00100000:0.0:1788529893.941434:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185622528 00000100:00100000:0.0:1788529893.941505:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788529893.941516:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875409185622528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788529893.941808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875409185622528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 293us (749us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788529893.941817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788529893.941981:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc80700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185622528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788529893.942050:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788529893.942103:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942115:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942125:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942132:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529893.942137:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942145:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942165:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:1.0:1788529893.942169:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788529893.942176:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529893.942183:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101e00/0xaa46022e3f18ba0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788529893.942406:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788529893.942584:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788529893.942600:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403912705138ns, next at 404912701801ns, rc = 0 00000001:00080000:1.0:1788529893.942608:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788529893.942643:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc8c54200) 00010000:00010000:1.0:1788529893.942660:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788529893.942670:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18b9f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fc3 expref: 32 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529893.942988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+31:11403:x1875409158345344:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 26313us (26610us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788529893.942999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000020:00080000:1.0:1788529893.943003:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788529893.947483:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529893.947688:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158345600 00000100:00100000:0.0:1788529893.947702:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158345600 00000100:00100000:0.0:1788529893.947786:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:0.0:1788529893.947798:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+31:11403:x1875409158345600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529893.947830:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529893.947861:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18ba12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.948017:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18ba12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fca expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.948034:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18ba12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fca expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529893.948057:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529893.948061:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529893.948067:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de400, rc 0) 00000100:00100000:0.0:1788529893.948140:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:11403:x1875409158345600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 344us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529893.948147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:0.0:1788529893.954335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529893.954515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158345856 00000100:00100000:2.0:1788529893.954529:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158345856 00000100:00100000:2.0:1788529893.954621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:2.0:1788529893.954636:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:11403:x1875409158345856:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1788529893.955091:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+33:11403:x1875409158345856:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 457us (772us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788529893.955100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000001:00080000:1.0:1788529894.041462:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1788529894.041503:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788529894.063660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529894.066983:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158346112 00000100:00100000:3.0:1788529894.067006:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158346112 00000100:00100000:0.0:1788529894.067170:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:0.0:1788529894.067195:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+33:11413:x1875409158346112:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529894.067233:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529894.067265:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18ba19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fd1 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529894.067399:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788529894.067571:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18ba19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd1 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.067591:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:0.0:1788529894.067595:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529894.067620:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18ba19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd1 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.067639:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61df800, rc 0) 00000100:00100000:0.0:1788529894.068061:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+34:11413:x1875409158346112:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 868us (4416us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788529894.068070:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:3.0:1788529894.070311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.070395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158346240 00000100:00100000:0.0:1788529894.070407:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158346240 00000100:00100000:0.0:1788529894.070478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:0.0:1788529894.070489:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:11413:x1875409158346240:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1788529894.070596:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070618:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070634:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070651:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070659:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070665:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070840:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070856:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070863:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529894.070960:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070976:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070985:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070993:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.070999:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529894.071004:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071012:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071025:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529894.071029:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529894.071034:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071042:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18ba27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071064:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071071:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071077:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071083:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529894.071086:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071093:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071101:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529894.071103:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529894.071106:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071112:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de600/0xaa46022e3f18ba2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071130:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071137:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071142:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071154:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529894.071157:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071163:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071172:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529894.071174:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529894.071177:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.071183:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529894.071265:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:11413:x1875409158346240:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 777us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.071274:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:1.0:1788529894.073429:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529894.073647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158346496 00000100:00100000:2.0:1788529894.073659:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158346496 00000100:00100000:2.0:1788529894.073775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1788529894.073788:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:11413:x1875409158346496:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1788529894.074122:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:11413:x1875409158346496:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 337us (705us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788529894.074131:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1788529894.116578:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529894.116817:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158346752 00000100:00100000:2.0:1788529894.116831:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158346752 00000100:00100000:2.0:1788529894.116941:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:2.0:1788529894.116953:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+35:11416:x1875409158346752:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529894.116987:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529894.117014:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18ba3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fd8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117112:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117130:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117143:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117159:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117166:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117409:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117573:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117583:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117590:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788529894.117602:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788529894.117737:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117746:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117753:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117760:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529894.117765:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117774:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117970:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529894.117975:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529894.117988:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.117995:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118012:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118019:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118025:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118030:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529894.118033:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118039:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118047:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc8c54900) 00010000:00010000:2.0:1788529894.118049:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529894.118052:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118058:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18ba4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118110:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18ba3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118137:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.118145:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:2.0:1788529894.118147:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529894.118150:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100a00, rc 0) 00000100:00100000:2.0:1788529894.118355:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+37:11416:x1875409158346752:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1403us (1802us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788529894.118364:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:3.0:1788529894.125065:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.125150:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158346880 00000100:00100000:0.0:1788529894.125164:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158346880 00000100:00100000:0.0:1788529894.125244:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:0.0:1788529894.125256:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+37:11416:x1875409158346880:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1788529894.125348:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125371:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125387:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125440:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125449:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125458:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125464:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529894.125469:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125478:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125492:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529894.125495:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529894.125501:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.125508:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529894.125619:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+37:11416:x1875409158346880:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 364us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.125627:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:1.0:1788529894.128535:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529894.128737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158347136 00000100:00100000:3.0:1788529894.128749:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158347136 00000100:00100000:3.0:1788529894.128829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1788529894.128843:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+37:11416:x1875409158347136:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788529894.129198:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+38:11416:x1875409158347136:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 357us (672us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788529894.129207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1788529894.390613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.390931:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158347392 00000100:00100000:0.0:1788529894.390946:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158347392 00000100:00100000:0.0:1788529894.391020:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:0.0:1788529894.391051:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+38:11447:x1875409158347392:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1788529894.391084:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529894.391122:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fdf expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.391418:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242c00/0xaa46022e3f18ba6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.391439:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242c00/0xaa46022e3f18ba6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.391454:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242c00/0xaa46022e3f18ba6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529894.391469:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788529894.391647:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fdf expref: 41 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.391671:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242c00/0xaa46022e3f18ba6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fdf expref: 40 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.392110:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529894.392114:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529894.392119:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242c00, rc 0) 00000100:00100000:0.0:1788529894.392276:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+40:11447:x1875409158347392:12345-192.168.201.52@tcp:101:cat.0 Request processed in 1225us (1684us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788529894.392284:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:1.0:1788529894.399575:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529894.400323:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529894.400465:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158347648 00000100:00100000:3.0:1788529894.400477:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158347648 00000100:00100000:3.0:1788529894.400563:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1788529894.400577:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:11447:x1875409158347648:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1788529894.401013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+41:11447:x1875409158347648:12345-192.168.201.52@tcp:35:cat.0 Request processed in 437us (1464us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788529894.401022:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1788529894.402143:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158347776 00000100:00100000:2.0:1788529894.402155:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158347776 00000100:00100000:2.0:1788529894.402330:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1788529894.402341:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+41:2355:x1875409158347776:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529894.402357:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529894.402386:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242c00/0xaa46022e3f18ba6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fdf expref: 41 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.402406:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:2.0:1788529894.402413:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529894.402469:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:2355:x1875409158347776:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 129us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529894.402476:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1788529894.447118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.447326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348032 00000100:00100000:0.0:1788529894.447340:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348032 00000100:00100000:0.0:1788529894.447437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:0.0:1788529894.447450:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+40:11453:x1875409158348032:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:0.0:1788529894.447482:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529894.447486:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788529894.447521:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18b9d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fb5 expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447546:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529894.447552:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529894.447585:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fe6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447717:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447733:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447743:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447796:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.447818:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 40 pid: 5829 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529894.447835:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185622656:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529894.448318:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529894.451747:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875409185622656:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529894.451793:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529894.452223:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.452293:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348160 00000100:00100000:0.0:1788529894.452301:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348160 00010000:00010000:0.0:1788529894.452344:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 41 pid: 5829 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529894.452388:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1788529894.452399:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+41:2354:x1875409158348160:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529894.452445:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529894.452454:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 41 pid: 5829 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452472:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 41 pid: 5829 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452499:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18ba51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fd8 expref: 41 pid: 5829 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452518:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529894.452523:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452533:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452639:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.452678:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529894.452758:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+40:2354:x1875409158348160:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 359us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.452766:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00010000:00010000:3.0:1788529894.453259:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.453269:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529894.453292:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788529894.453487:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242800/0xaa46022e3f18ba7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.453517:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.453527:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:3.0:1788529894.453530:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529894.453534:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243400, rc 0) 00000100:00100000:3.0:1788529894.453584:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+40:11453:x1875409158348032:12345-192.168.201.52@tcp:101:dd.0 Request processed in 6137us (6494us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788529894.453592:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:1.0:1788529894.457046:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529894.457332:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348416 00000100:00100000:2.0:1788529894.457346:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348416 00000100:00100000:2.0:1788529894.457417:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:2.0:1788529894.457447:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:11453:x1875409158348416:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:2.0:1788529894.458136:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.458161:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.458186:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529894.458256:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788529894.458289:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccf46c0f reply state 000000004a31f62c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529894.458301:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529894.458422:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+43:11453:x1875409158348416:12345-192.168.201.52@tcp:36:dd.0 Request processed in 975us (1389us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788529894.458430:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000020:00080000:2.0:1788529894.458436:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529894.465457:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465483:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465491:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465499:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529894.465505:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465515:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465537:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:3.0:1788529894.465541:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529894.465546:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.465583:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18ba90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529894.725477:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529894.725600:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348544 00000100:00100000:3.0:1788529894.725616:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348544 00000100:00100000:3.0:1788529894.725704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:3.0:1788529894.725725:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+42:11467:x1875409158348544:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:3.0:1788529894.725760:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529894.725991:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18ba97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0fed expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726084:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726102:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726115:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726132:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726140:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726147:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726331:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726354:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726363:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726408:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.726430:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 43 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529894.726447:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185622784:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529894.726645:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788529894.734390:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529894.734733:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529894.734856:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185622784:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529894.734926:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529894.735097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348800 00000100:00100000:1.0:1788529894.735107:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348800 00000100:00100000:1.0:1788529894.735276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1788529894.735289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+44:5597:x1875409158348800:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788529894.735730:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:5597:x1875409158348800:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 441us (1004us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788529894.735760:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1788529894.741050:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529894.742083:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158348928 00000100:00100000:2.0:1788529894.742099:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158348928 00010000:00010000:2.0:1788529894.742158:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 45 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529894.742226:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:2.0:1788529894.742239:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3eff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:2354:x1875409158348928:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529894.742258:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529894.742267:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 45 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742308:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 45 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742341:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18ba82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fe6 expref: 45 pid: 5830 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742362:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:2.0:1788529894.742369:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742380:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742390:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529894.742431:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529894.742514:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3eff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+44:2354:x1875409158348928:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 275us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529894.742522:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00010000:00010000:1.0:1788529894.744318:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744340:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529894.744414:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788529894.744420:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529894.744447:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744467:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744479:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744487:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744494:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744501:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529894.744507:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744516:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744568:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529894.744572:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529894.744578:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744586:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18ba9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744606:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744614:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744620:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744625:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529894.744628:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744635:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744643:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230300) 00010000:00010000:1.0:1788529894.744645:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529894.744648:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744655:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18baa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744723:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18ba97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fed expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744741:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fed expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529894.744748:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:1.0:1788529894.744751:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529894.744754:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:0.0:1788529894.745568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+43:11467:x1875409158348544:12345-192.168.201.52@tcp:101:stat.0 Request processed in 19829us (20090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.745580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:1.0:1788529894.824691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529894.824946:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158349184 00000100:00100000:0.0:1788529894.824960:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158349184 00000100:00100000:0.0:1788529894.825043:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:0.0:1788529894.825054:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+43:11473:x1875409158349184:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:0.0:1788529894.825135:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529894.825178:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18baac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fed expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.825203:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529894.825210:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529894.825484:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.825504:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529894.825516:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788529894.825614:0:7603:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788529894.825638:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dee88cac reply state 0000000083e0a040 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529894.825649:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788529894.826178:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+45:11473:x1875409158349184:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 1123us (1508us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788529894.826187:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 157 00000020:00080000:0.0:1788529894.826193:0:7603:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788529894.836177:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836203:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836213:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836219:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529894.836246:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836256:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836280:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:3.0:1788529894.836283:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529894.836290:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529894.836297:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bab3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529894.989319:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529894.989352:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185622912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529894.989453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529894.989641:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185622912 00000100:00100000:0.0:1788529894.989653:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185622912 00000100:00100000:0.0:1788529894.989741:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788529894.989754:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185622912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529894.989806:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529894.989866:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185622912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.989874:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788529894.989962:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529894.990009:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185622912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529894.990212:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185623168:0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.990254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529894.990281:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529894.990286:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.990310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529894.990344:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185623168 00000100:00100000:1.0:1788529894.990348:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185623168 00000100:00100000:1.0:1788529894.990384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185623296 00000100:00100000:1.0:1788529894.990387:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185623296 00000100:00100000:1.0:1788529894.990414:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788529894.990420:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185623168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.990460:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185623168:12345-0@lo:400:kworker.0 Request processed in 40us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529894.990467:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788529894.990480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788529894.990485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185623296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.990535:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185623296:12345-0@lo:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529894.990541:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1788529894.990569:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529894.990588:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.990599:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185623168:0@lo:400:kworker.0 00000100:00100000:3.0:1788529894.990891:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788529894.990951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529894.990995:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185623552:0@lo:400:kworker.0 00000100:00100000:3.0:1788529894.991019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529894.991034:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529894.991039:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788529894.991062:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529894.992235:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185623424 00000100:00100000:0.0:1788529894.992251:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185623424 00000100:00100000:0.0:1788529894.992334:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788529894.992345:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185623424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529894.992436:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185623424:12345-0@lo:400:kworker.0 Request processed in 92us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.992445:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788529894.992496:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788529894.992503:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788529894.992528:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185623424:0@lo:400:kworker.0 00000100:00100000:0.0:1788529894.992580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185623552 00000100:00100000:0.0:1788529894.992584:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185623552 00000100:00100000:0.0:1788529894.992615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788529894.992621:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185623552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529894.992661:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185623552:12345-0@lo:400:kworker.0 Request processed in 40us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529894.992668:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788529894.992707:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185623552:0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.999603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185623040 00000100:00100000:1.0:1788529894.999625:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185623040 00000100:00100000:1.0:1788529894.999736:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788529894.999751:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185623040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529894.999964:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185623040:12345-0@lo:400:kworker.0 Request processed in 215us (9010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529894.999973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1788529895.000019:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529895.000309:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788529895.034488:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.034621:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158349312 00000100:00100000:0.0:1788529895.034636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158349312 00000100:00100000:0.0:1788529895.034756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00100000:0.0:1788529895.034770:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+44:11487:x1875409158349312:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:0.0:1788529895.034804:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529895.034831:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18baba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ff4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.034974:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.034991:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035004:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035018:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035029:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035033:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035147:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035155:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035160:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.035204:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788529895.035209:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529895.035233:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035245:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035252:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035259:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035265:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035282:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.035287:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035297:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035311:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529895.035314:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.035319:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035323:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bac1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035337:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035341:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035345:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035348:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.035349:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035354:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035373:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529895.035375:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.035378:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18bac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035423:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18baba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035437:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.035445:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.035447:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529895.035450:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242e00, rc 0) 00000100:00100000:0.0:1788529895.035516:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+45:11487:x1875409158349312:12345-192.168.201.52@tcp:101:stat.0 Request processed in 751us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.035521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00080000:2.0:1788529895.035726:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529895.125450:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.125996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158349568 00000100:00100000:0.0:1788529895.126009:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158349568 00000100:00100000:0.0:1788529895.126084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:0.0:1788529895.126102:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+45:11497:x1875409158349568:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529895.126518:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529895.126606:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da0ffb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.126758:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788529895.130204:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bad6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ffb expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.130232:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:0.0:1788529895.130235:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529895.130241:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ffb expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.130273:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243800, rc 0) 00000100:00100000:0.0:1788529895.130388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+46:11497:x1875409158349568:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 4286us (4949us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788529895.130399:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:0.0:1788529895.146006:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.146219:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158349824 00000100:00100000:2.0:1788529895.146233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158349824 00000100:00100000:2.0:1788529895.146466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1788529895.146480:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+46:11497:x1875409158349824:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1788529895.146815:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+47:11497:x1875409158349824:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 337us (823us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788529895.146847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1788529895.219682:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.219833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350080 00000100:00100000:0.0:1788529895.219847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350080 00000100:00100000:0.0:1788529895.219963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:0.0:1788529895.219976:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+47:11503:x1875409158350080:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529895.220010:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529895.220037:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bae4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1002 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.220204:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.220224:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.220262:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.220312:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.220334:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 48 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529895.220351:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185623680:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529895.220493:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e83840 going to sleep for 11 seconds 00000100:00100000:3.0:1788529895.238788:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.238932:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350208 00000100:00100000:2.0:1788529895.238947:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350208 00010000:00010000:2.0:1788529895.239007:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 49 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529895.239066:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:2.0:1788529895.239078:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+49:2355:x1875409158350208:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529895.239107:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529895.239117:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 49 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.239140:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 49 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.239181:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:2.0:1788529895.239188:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.239199:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.239207:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.239233:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529895.239477:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+49:2355:x1875409158350208:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 400us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529895.239499:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00010000:00010000:0.0:1788529895.239641:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bacf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ff4 expref: 48 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529895.239662:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185623680:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529895.239690:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.239813:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.239822:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.239847:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788529895.240114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bae4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.240147:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.240166:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.240170:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788529895.240173:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243000, rc 0) 00000100:00100000:0.0:1788529895.240211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+48:11503:x1875409158350080:12345-192.168.201.52@tcp:101:bash.0 Request processed in 20238us (20551us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788529895.240218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:1.0:1788529895.245500:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.245629:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350464 00000100:00100000:2.0:1788529895.245644:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350464 00000100:00100000:2.0:1788529895.245727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:2.0:1788529895.245741:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+48:11503:x1875409158350464:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1788529895.246414:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.246436:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.246450:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529895.246516:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788529895.246559:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007db23716 reply state 0000000018013854 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529895.246569:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788529895.246696:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:11503:x1875409158350464:12345-192.168.201.52@tcp:36:bash.0 Request processed in 956us (1209us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788529895.246705:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 161 00000020:00080000:2.0:1788529895.246712:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788529895.250101:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250122:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250131:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250137:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529895.250143:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250185:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250207:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:1.0:1788529895.250210:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529895.250216:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.250223:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18baf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529895.265658:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529895.267375:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350592 00000100:00100000:3.0:1788529895.267392:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350592 00000100:00100000:3.0:1788529895.267475:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 162 00000100:00100000:3.0:1788529895.267486:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:11503:x1875409158350592:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529895.267517:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529895.267555:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bb00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1009 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.267658:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.267675:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.267686:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.267732:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.267761:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 51 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529895.267781:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185623808:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529895.268001:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54480 going to sleep for 11 seconds 00000100:00100000:0.0:1788529895.279040:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185623808:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529895.279084:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529895.279875:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.280535:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350720 00000100:00100000:2.0:1788529895.280557:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350720 00010000:00010000:2.0:1788529895.280612:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 52 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529895.280655:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:2.0:1788529895.280685:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:2354:x1875409158350720:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529895.280706:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529895.280715:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 52 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280736:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 52 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280762:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18baeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1002 expref: 52 pid: 5831 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280794:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:2.0:1788529895.280799:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280811:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280820:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529895.280855:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529895.280971:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+51:2354:x1875409158350720:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 287us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529895.280980:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00010000:00010000:0.0:1788529895.281190:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.281200:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.281263:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788529895.281268:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529895.281293:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.281331:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bb00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1009 expref: 51 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.281362:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1009 expref: 50 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.281380:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.281383:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529895.281386:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:0.0:1788529895.281420:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:11503:x1875409158350592:12345-192.168.201.52@tcp:101:bash.0 Request processed in 13935us (15775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.281428:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 162 00000100:00100000:1.0:1788529895.292558:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.292729:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158350976 00000100:00100000:0.0:1788529895.292743:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158350976 00000100:00100000:0.0:1788529895.292825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1788529895.292840:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+50:11503:x1875409158350976:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1788529895.293202:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:11503:x1875409158350976:12345-192.168.201.52@tcp:35:bash.0 Request processed in 363us (669us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788529895.293211:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1788529895.369034:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.369159:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158351232 00000100:00100000:0.0:1788529895.369175:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158351232 00000100:00100000:0.0:1788529895.369257:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:0.0:1788529895.369270:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+51:11513:x1875409158351232:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529895.369303:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529895.369332:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1010 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.369466:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788529895.369642:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1010 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.369698:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:0.0:1788529895.369702:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529895.369709:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1010 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.369728:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243800, rc 0) 00000100:00100000:0.0:1788529895.369809:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:11513:x1875409158351232:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 541us (791us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788529895.369818:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:2.0:1788529895.374475:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.374611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158351360 00000100:00100000:0.0:1788529895.374624:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158351360 00000100:00100000:0.0:1788529895.374718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:0.0:1788529895.374731:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+52:11513:x1875409158351360:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:0.0:1788529895.374839:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.374861:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.374876:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.374917:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.374926:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.374958:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375075:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375086:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375094:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788529895.375150:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375179:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375187:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375196:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375204:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.375209:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375219:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375234:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529895.375244:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.375251:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375259:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375276:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375282:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375289:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375295:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.375297:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375305:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375313:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529895.375316:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.375319:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375324:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375342:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375452:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375459:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375465:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.375468:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375475:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375485:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.375487:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.375491:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.375497:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529895.375618:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+52:11513:x1875409158351360:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 887us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.375627:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:1.0:1788529895.378259:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.378555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158351616 00000100:00100000:0.0:1788529895.378568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158351616 00000100:00100000:0.0:1788529895.378642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1788529895.378655:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:11513:x1875409158351616:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529895.378978:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+53:11513:x1875409158351616:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 324us (733us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788529895.379004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:2.0:1788529895.456834:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.456974:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158351872 00000100:00100000:0.0:1788529895.456988:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158351872 00000100:00100000:0.0:1788529895.457071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 165 00000100:00100000:0.0:1788529895.457085:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+53:11516:x1875409158351872:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788529895.457118:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529895.457146:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1017 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457270:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457290:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457306:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457322:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457329:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457337:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457499:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457533:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457556:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529895.457570:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788529895.457708:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457717:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457725:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457731:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.457736:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457744:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457760:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529895.457764:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.457770:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457778:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bb38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457797:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457810:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457817:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457823:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.457826:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457834:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457842:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529895.457845:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529895.457848:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457855:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457975:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1017 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.457993:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1017 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.458001:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.458003:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788529895.458012:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243800, rc 0) 00000100:00100000:0.0:1788529895.458298:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:11516:x1875409158351872:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1215us (1478us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788529895.458307:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 165 00000100:00100000:2.0:1788529895.469045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.473473:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529895.473616:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352128 00000100:00100000:3.0:1788529895.473631:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352128 00000100:00100000:3.0:1788529895.473795:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788529895.473807:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+55:2354:x1875409158352128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529895.473848:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529895.473883:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243800/0xaa46022e3f18bb46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1017 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529895.473956:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:3.0:1788529895.473963:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529895.474038:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+54:2354:x1875409158352128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 232us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529895.474046:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1788529895.476038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352000 00000100:00100000:0.0:1788529895.476062:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352000 00000100:00100000:0.0:1788529895.476162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 166 00000100:00100000:0.0:1788529895.476174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:11516:x1875409158352000:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1788529895.476275:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476297:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476311:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476346:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476354:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476362:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476369:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529895.476374:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476382:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476416:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:0.0:1788529895.476419:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529895.476426:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.476434:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243200/0xaa46022e3f18bb54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529895.476551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:11516:x1875409158352000:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 366us (7509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.476560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 166 00000100:00100000:2.0:1788529895.482133:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.482279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352384 00000100:00100000:0.0:1788529895.482292:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352384 00000100:00100000:0.0:1788529895.482360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:0.0:1788529895.482371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+54:11516:x1875409158352384:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529895.482686:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:11516:x1875409158352384:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 316us (572us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788529895.482694:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1788529895.681418:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529895.681574:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352640 00000100:00100000:1.0:1788529895.681589:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352640 00000100:00100000:1.0:1788529895.681678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:1.0:1788529895.681690:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+55:11534:x1875409158352640:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1788529895.681723:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529895.681752:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da101e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.681938:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.681958:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.681994:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529895.682007:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788529895.682179:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da101e expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.682203:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da101e expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.682213:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:1.0:1788529895.682217:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788529895.682222:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529895.682304:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+57:11534:x1875409158352640:12345-192.168.201.52@tcp:101:cat.0 Request processed in 616us (901us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788529895.682312:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:2.0:1788529895.707089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.707142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.707181:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529895.707226:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.707326:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352768 00000100:00100000:0.0:1788529895.707341:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352768 00000100:00100000:0.0:1788529895.707417:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 335 00000100:00100000:0.0:1788529895.707429:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158352768:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529895.707547:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158352768:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 120us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.707555:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 335 00000100:00100000:0.0:1788529895.707712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353152 00000100:00100000:0.0:1788529895.707737:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353152 00000100:00100000:0.0:1788529895.707780:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:0.0:1788529895.707787:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158353152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529895.707824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38bca45c-488d-404b-89e3-533f2a694da6+5:2354:x1875409158353152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.707831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:1.0:1788529895.711677:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353024 00000100:00100000:1.0:1788529895.711698:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353024 00000100:00100000:1.0:1788529895.711795:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158352896 00000100:00100000:1.0:1788529895.711799:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158352896 00000100:00100000:1.0:1788529895.711847:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1788529895.711861:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158353024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529895.712003:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158353024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 145us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529895.712011:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1788529895.712030:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1788529895.712037:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158352896:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529895.712085:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158352896:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 48us (4903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529895.712092:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00080000:2.0:1788529895.712442:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788529895.712449:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788529895.712452:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529895.725681:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529895.725840:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353280 00000100:00100000:1.0:1788529895.725855:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353280 00000100:00100000:1.0:1788529895.725973:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:1.0:1788529895.725985:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+57:11535:x1875409158353280:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529895.726024:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529895.726054:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1025 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726151:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726170:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726186:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529895.726236:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788529895.726241:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529895.726264:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726296:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1025 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726320:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1025 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.726349:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529895.726353:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529895.726358:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788529895.726446:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11535:x1875409158353280:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 462us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529895.726453:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:2.0:1788529895.746224:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.746432:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353664 00000100:00100000:0.0:1788529895.746446:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353664 00000100:00100000:0.0:1788529895.746520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1788529895.746544:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11535:x1875409158353664:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529895.747029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:11535:x1875409158353664:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 496us (820us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788529895.747038:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1788529895.750162:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529895.750297:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353792 00000100:00100000:1.0:1788529895.750311:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353792 00000100:00100000:1.0:1788529895.750398:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788529895.750411:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+59:11535:x1875409158353792:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:1.0:1788529895.750430:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788529895.750462:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bb07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1009 expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.750490:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da101e expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.750504:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de400/0xaa46022e3f18ba12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0fca expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.750515:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09e00) 00010000:00010000:1.0:1788529895.750542:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529895.750618:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+56:11535:x1875409158353792:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 209us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529895.750626:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1788529895.754181:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529895.754391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158353920 00000100:00100000:0.0:1788529895.754406:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158353920 00000100:00100000:0.0:1788529895.754485:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 169 00000100:00100000:0.0:1788529895.754498:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+56:11535:x1875409158353920:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:0.0:1788529895.754662:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.754683:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529895.754697:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788529895.755321:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788529895.755418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+56:11535:x1875409158353920:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 920us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529895.755446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 169 00010000:00010000:3.0:1788529895.757722:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529895.775427:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529895.775590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354048 00000100:00100000:1.0:1788529895.775603:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354048 00000100:00100000:1.0:1788529895.775679:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 170 00000100:00100000:1.0:1788529895.775692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+56:11537:x1875409158354048:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529895.775735:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529895.775765:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da102c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776043:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776063:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776170:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776192:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776200:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776208:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776390:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776400:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776432:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529895.776479:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788529895.776484:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529895.776942:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776959:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776968:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776976:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776984:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.776991:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529895.776996:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777005:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777019:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529895.777022:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529895.777027:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777045:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bb8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777062:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777067:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777073:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777768:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529895.777773:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777782:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777793:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc3837000) 00010000:00010000:1.0:1788529895.777796:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529895.777800:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.777807:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bb93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.778132:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bb85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.778151:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529895.778174:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:1.0:1788529895.778177:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529895.778180:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48200, rc 0) 00000100:00100000:1.0:1788529895.778362:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+57:11537:x1875409158354048:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2670us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529895.778373:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 170 00000040:00080000:3.0:1788529896.269237:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788529896.269251:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788529896.269327:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788529896.269335:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788529896.269648:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185623936:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788529896.269783:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529896.278662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.279499:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185623936:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788529896.283311:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354176 00000100:00100000:1.0:1788529896.283335:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354176 00000100:00100000:0.0:1788529896.283658:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 171 00000100:00100000:0.0:1788529896.283673:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:11548:x1875409158354176:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788529896.283717:0:7603:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788529896.283927:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:11548:x1875409158354176:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 222us (5246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529896.283937:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 171 00000100:00100000:2.0:1788529896.293437:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.293559:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354304 00000100:00100000:1.0:1788529896.293573:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354304 00000100:00100000:1.0:1788529896.293650:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:1.0:1788529896.293664:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+57:11548:x1875409158354304:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788529896.293789:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.293815:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.293834:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296496:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296535:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296551:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296821:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296832:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.296840:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529896.296971:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788529896.296977:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529896.296992:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297007:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297014:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297021:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297027:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.297032:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297039:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297051:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529896.297061:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529896.297067:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297074:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bba1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297091:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297097:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297103:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297107:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.297110:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.297116:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301063:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cabc3837000) 00010000:00010000:1.0:1788529896.301072:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529896.301081:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301091:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bba8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301132:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301156:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301164:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301169:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.301173:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301180:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301187:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:1.0:1788529896.301190:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529896.301193:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.301198:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bbaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.301312:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+57:11548:x1875409158354304:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 7646us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.301323:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:3.0:1788529896.308679:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.308832:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354560 00000100:00100000:1.0:1788529896.308847:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354560 00000100:00100000:1.0:1788529896.308955:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:1.0:1788529896.308968:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+57:11548:x1875409158354560:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529896.308997:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529896.309031:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1033 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309175:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309194:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309208:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529896.309222:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788529896.309356:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309365:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309373:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309379:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.309383:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309392:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309406:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:1.0:1788529896.309408:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529896.309414:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309431:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309481:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bbb6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1033 expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309492:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529896.309495:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529896.309500:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bbb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1033 expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.309510:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49800, rc 0) 00000100:00100000:1.0:1788529896.310721:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158354560:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1746us (2051us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788529896.310732:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:3.0:1788529896.314994:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.323619:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354688 00000100:00100000:1.0:1788529896.323642:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354688 00000100:00100000:1.0:1788529896.323731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:1.0:1788529896.323746:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158354688:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788529896.323799:0:5830:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788529896.323981:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158354688:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 237us (9003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.323990:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:0.0:1788529896.329060:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.336105:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158354944 00000100:00100000:1.0:1788529896.336127:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158354944 00000100:00100000:1.0:1788529896.336224:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:1.0:1788529896.336249:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158354944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529896.336277:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529896.336281:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788529896.336315:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bb77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1025 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.336336:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529896.336353:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529896.336372:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bbcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da103a expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788529896.336976:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788529896.337231:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.337249:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.337261:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.337330:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bbcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da103a expref: 60 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.337347:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da103a expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.337356:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529896.337359:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529896.337370:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529896.337459:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+59:11548:x1875409158354944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1214us (8414us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788529896.337468:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:3.0:1788529896.348933:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.349060:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158355200 00000100:00100000:1.0:1788529896.349075:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158355200 00000100:00100000:1.0:1788529896.349170:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:1.0:1788529896.349184:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:11548:x1875409158355200:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788529896.349263:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529896.349299:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bbd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da103a expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349322:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529896.349334:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529896.349365:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349382:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349394:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349412:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349420:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349428:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349537:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349546:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349554:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349561:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.349566:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349576:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349586:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529896.349590:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529896.349595:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349601:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bbe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349610:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349617:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349624:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349636:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.349640:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349646:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349655:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc152055e (ffff8cabc3837d00) 00010000:00010000:1.0:1788529896.349658:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529896.349661:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.349667:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bbe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc152055e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.349774:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158355200:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 593us (892us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529896.349783:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:1.0:1788529896.368761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.370421:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158355328 00000100:00100000:0.0:1788529896.370442:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158355328 00000100:00100000:0.0:1788529896.370537:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:0.0:1788529896.370550:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+58:11548:x1875409158355328:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529896.370579:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529896.370611:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bbee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1041 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370661:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370679:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370694:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370830:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243600/0xaa46022e3f18bbee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 60 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370850:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 59 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.370860:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:0.0:1788529896.370864:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788529896.370869:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243e00, rc 0) 00000100:00100000:0.0:1788529896.370982:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+59:11548:x1875409158355328:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 434us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529896.370991:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:0.0:1788529896.376962:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.377035:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158355584 00000100:00100000:3.0:1788529896.377045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158355584 00000100:00100000:3.0:1788529896.377142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:3.0:1788529896.377154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:11548:x1875409158355584:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.377239:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.377257:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.377282:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529896.377576:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788529896.377587:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406347691932ns, next at 407347689843ns, rc = 0 00000004:00010000:3.0:1788529896.377667:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004aa70e36 reply state 00000000bf5334a1 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.377676:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529896.377765:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+61:11548:x1875409158355584:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 613us (809us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788529896.377773:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 178 00010000:00010000:1.0:1788529896.388395:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388411:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388419:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388426:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529896.388432:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388457:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388476:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:1.0:1788529896.388479:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788529896.388485:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.388492:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bbfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.398411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.398699:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158355712 00000100:00100000:3.0:1788529896.398712:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158355712 00000100:00100000:3.0:1788529896.398789:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:3.0:1788529896.398801:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+60:11548:x1875409158355712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.398833:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529896.398862:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1048 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.398970:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 61 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.398988:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 61 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.399031:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.399035:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529896.399041:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529896.399109:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+61:11548:x1875409158355712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 310us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.399117:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:1.0:1788529896.408585:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.414702:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158355840 00000100:00100000:3.0:1788529896.414722:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158355840 00000100:00100000:3.0:1788529896.419073:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1788529896.419091:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2354:x1875409158355840:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788529896.419583:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158355840:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 494us (11012us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788529896.419593:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1788529896.423848:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.424050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356096 00000100:00100000:0.0:1788529896.424063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356096 00000100:00100000:0.0:1788529896.424376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1788529896.424390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+61:11548:x1875409158356096:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788529896.425381:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+62:11548:x1875409158356096:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 988us (1543us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788529896.425392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1788529896.431359:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.431700:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356352 00000100:00100000:1.0:1788529896.431714:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356352 00000100:00100000:1.0:1788529896.431794:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:1.0:1788529896.431808:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+62:11548:x1875409158356352:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788529896.431982:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+62:11548:x1875409158356352:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 176us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.431991:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:1.0:1788529896.439533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.439986:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356480 00000100:00100000:3.0:1788529896.440000:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356480 00000100:00100000:3.0:1788529896.440080:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:3.0:1788529896.440093:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+62:11548:x1875409158356480:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.440122:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529896.440163:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bc0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da104f expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440282:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440306:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440321:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529896.440372:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529896.440398:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440431:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bc0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da104f expref: 64 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440454:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da104f expref: 63 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.440464:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.440468:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788529896.440472:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:3.0:1788529896.440573:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+63:11548:x1875409158356480:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 481us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.440582:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:1.0:1788529896.444328:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.444474:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356608 00000100:00100000:3.0:1788529896.444487:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356608 00000100:00100000:3.0:1788529896.444585:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1788529896.444599:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158356608:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.444623:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529896.444661:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1056 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788529896.444697:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9acce8, blocks: 0x1 00010000:00010000:3.0:1788529896.444723:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1788529896.444728:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529896.444739:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.444775:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.444792:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529896.444879:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158356608:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 281us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.444888:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1788529896.449067:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.449249:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356864 00000100:00100000:1.0:1788529896.449261:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356864 00000100:00100000:1.0:1788529896.449331:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:1.0:1788529896.449345:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+63:11548:x1875409158356864:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788529896.449496:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+63:11548:x1875409158356864:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 154us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.449532:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:0.0:1788529896.452300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.452387:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158356992 00000100:00100000:3.0:1788529896.452399:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158356992 00000100:00100000:3.0:1788529896.452472:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1788529896.452484:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:11548:x1875409158356992:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.452508:0:12086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529896.452546:0:12086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da105d expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.452588:0:12086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.452621:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529896.452627:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529896.452634:0:12086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.452681:0:12086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.452704:0:12086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.452722:0:12086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12086:1875409185624064:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529896.452930:0:12086:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529896.458310:0:12086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12086:1875409185624064:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529896.458364:0:12086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.458394:0:12086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031000, rc 0) 00000100:00100000:2.0:1788529896.458475:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+9:11548:x1875409158356992:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 5991us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529896.458485:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1788529896.460071:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529896.464546:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357120 00000100:00100000:2.0:1788529896.464570:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357120 00010000:00010000:2.0:1788529896.464642:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529896.464731:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:2.0:1788529896.464743:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158357120:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529896.465038:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529896.465070:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.465092:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.465121:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fcaa81/0xaa46022e3f18bc18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1056 expref: 9 pid: 6688 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.465152:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529896.465158:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529896.465170:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.465183:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.465239:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529896.465258:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185624192:192.168.201.52@tcp:105: 00000100:00100000:2.0:1788529896.465419:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788529896.471251:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.471434:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357248 00000100:00100000:0.0:1788529896.471447:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357248 00002000:00100000:0.0:1788529896.471532:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cabf563f480 x1875409158357248/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:592/0 lens 504/0 e 0 to 0 dl 1788529907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529896.471560:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf563f480 with x1875409158357248 ext(0->8) 00002000:00010000:0.0:1788529896.471567:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabf563f480 00000100:00100000:0.0:1788529896.471610:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1788529896.471621:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158357248:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788529896.472256:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14b4f045-1109-44f4-a991-3ed448c68aea+11:2355:x1875409158357248:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 634us (1017us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788529896.472267:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00002000:00100000:0.0:1788529896.472275:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cabf563f480 x1875409158357248/t4294967314(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:592/0 lens 504/448 e 0 to 0 dl 1788529907 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788529896.472285:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf563f480 with x1875409158357248 ext(0->8) 00002000:00010000:0.0:1788529896.472289:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabf563f480 00000100:00100000:2.0:1788529896.472638:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875409185624192:192.168.201.52@tcp:105: 00010000:00010000:2.0:1788529896.472673:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529896.472721:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+10:2355:x1875409158357120:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 7980us (12660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529896.472731:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:3.0:1788529896.488443:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.488769:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357376 00000100:00100000:0.0:1788529896.488784:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357376 00000100:00100000:0.0:1788529896.488863:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:0.0:1788529896.488876:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+63:11548:x1875409158357376:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788529896.555869:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788529896.555953:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788529896.555997:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788529896.556017:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8caac5d540c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788529896.556023:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc2bb4200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8caac5d54900 00000020:00080000:0.0:1788529896.556027:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc2bb4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabfcb89400 00000100:00100000:2.0:1788529896.556614:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788529896.556640:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185624320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788529896.556726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788529896.557481:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788529896.557725:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788529896.559507:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185624448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788529896.559601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529896.559670:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185624320 00000100:00100000:2.0:1788529896.559683:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185624320 00000100:00100000:3.0:1788529896.560349:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185624448 00000100:00100000:3.0:1788529896.560356:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185624448 00000100:00100000:3.0:1788529896.560403:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788529896.560415:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185624320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788529896.560456:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788529896.560501:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9acce5, atime: 0x0, ctime: 0x6a9acce5, blocks: 0xb 00010000:00010000:3.0:1788529896.560511:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.560550:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1788529896.560570:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529896.560578:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.560599:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.560611:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.560620:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.560642:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788529896.561402:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185624320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 987us (4673us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788529896.561411:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788529896.561438:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788529896.561448:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185624448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788529896.561587:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788529896.561591:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788529896 00002000:00010000:3.0:1788529896.561594:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788529896.561596:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788529896 -> 1788529896 00002000:00010000:3.0:1788529896.561599:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788529896.561623:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185624448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (2022us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788529896.561629:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788529896.562507:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+18:11548:x1875409158357376:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 73627us (74074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529896.562529:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00080000:2.0:1788529896.562630:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788529896.562637:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788529896.562653:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529896.562663:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.562677:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529896.562682:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.562696:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.562719:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.562737:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18bc26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529896.564391:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529896.564397:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529896.564400:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788529896.564465:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabf5fb2a00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788529896.564477:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185624448:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1788529896.564492:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabf569c380/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788529896.564496:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf569c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185624320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788529896.583004:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.584027:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357504 00000100:00100000:0.0:1788529896.584041:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357504 00000100:00100000:0.0:1788529896.584118:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1788529896.584130:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+10:2354:x1875409158357504:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788529896.666417:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788529896.666447:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788529896.666557:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158357504:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 82419us (83557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.666572:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:2.0:1788529896.676496:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.679481:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357760 00000100:00100000:3.0:1788529896.679502:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357760 00000100:00100000:3.0:1788529896.679604:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:3.0:1788529896.679616:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+18:11548:x1875409158357760:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.679684:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529896.679719:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bc11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da104f expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.679738:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.679758:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529896.679798:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.679814:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.679825:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529896.680236:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ce32ea6 reply state 00000000060a687d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.680247:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788529896.684742:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:11548:x1875409158357760:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 5109us (8243us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788529896.684757:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 184 00010000:00010000:3.0:1788529896.690953:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.690977:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.691002:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.691009:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529896.691015:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.691024:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.691025:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1788529896.691045:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.691049:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529896.691055:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.691062:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.693344:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158357888 00000100:00100000:0.0:1788529896.693363:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158357888 00000100:00100000:0.0:1788529896.695499:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1788529896.695538:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158357888:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788529896.695879:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788529896.695884:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788529896 -> 1788529895 00002000:00010000:0.0:1788529896.695887:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788529893 00002000:00010000:0.0:1788529896.695890:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788529896 -> 1788529895 00002000:00010000:0.0:1788529896.695910:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788529896.696011:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158357888:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 497us (4990us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788529896.696021:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1788529896.705817:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.706294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358144 00000100:00100000:3.0:1788529896.706309:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358144 00000100:00100000:3.0:1788529896.706389:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:3.0:1788529896.706401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+18:11548:x1875409158358144:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788529896.706504:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.706536:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.706550:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.706602:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.706622:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 18 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.706639:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185624576:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529896.706777:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54900 going to sleep for 11 seconds 00000100:00100000:3.0:1788529896.712832:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.712876:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358272 00000100:00100000:3.0:1788529896.712888:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358272 00010000:00010000:3.0:1788529896.712967:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.713015:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:3.0:1788529896.713028:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2355:x1875409158358272:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529896.713050:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529896.713058:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.713078:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.713105:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.713112:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.713162:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.713172:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.713199:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529896.713263:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2355:x1875409158358272:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 238us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.713272:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00010000:00010000:0.0:1788529896.713613:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bbf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1041 expref: 18 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.713635:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185624576:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529896.713670:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713681:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713687:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713725:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713733:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713751:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713759:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529896.713765:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713775:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713787:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:0.0:1788529896.713791:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788529896.713794:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.713800:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.713863:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+17:11548:x1875409158358144:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 7465us (8061us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788529896.713873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:3.0:1788529896.718732:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.719316:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358400 00000100:00100000:0.0:1788529896.719343:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358400 00000100:00100000:0.0:1788529896.719422:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:0.0:1788529896.720851:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158358400:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788529896.720931:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.720957:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.720966:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529896.720971:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529896.720976:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.721019:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.721041:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 8 pid: 12086 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.721058:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185624704:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529896.721249:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd009fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529896.725872:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529896.727399:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875409185624704:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529896.727454:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.727670:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358528 00000100:00100000:1.0:1788529896.727680:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358528 00010000:00010000:1.0:1788529896.727756:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.727807:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:1.0:1788529896.727819:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3effc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+9:2354:x1875409158358528:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529896.727839:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529896.727869:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.727889:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.727941:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bc1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da105d expref: 9 pid: 12086 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.727963:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529896.727968:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529896.727974:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.727996:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.728031:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529896.728104:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3effc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158358528:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 286us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.728111:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00010000:00010000:0.0:1788529896.728540:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728552:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728584:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728594:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728603:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728611:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529896.728616:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728626:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728639:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.728664:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000836dc94/0xaa46022e3f18bc3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.728753:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158358400:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 7909us (10028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529896.728764:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1788529896.738502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529896.738594:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358784 00000100:00100000:0.0:1788529896.738608:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358784 00000100:00100000:0.0:1788529896.738676:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:0.0:1788529896.738688:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+17:11548:x1875409158358784:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788529896.738790:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.738811:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.738824:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.739110:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.739122:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.739132:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.739185:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 18 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.739205:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 18 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.739221:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185624832:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529896.739315:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd009f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788529896.757329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.758210:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158358912 00000100:00100000:3.0:1788529896.758225:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158358912 00010000:00010000:3.0:1788529896.758286:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.758358:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:3.0:1788529896.758370:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2354:x1875409158358912:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529896.758388:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529896.758396:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.758424:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 19 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.758459:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.758467:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.758505:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.758529:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.758556:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529896.758630:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2354:x1875409158358912:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 261us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529896.758638:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00010000:00010000:0.0:1788529896.759863:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1048 expref: 18 pid: 7603 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.759888:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185624832:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529896.759943:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.759955:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.759962:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788529896.760225:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788529896.768253:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788529896.768626:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788529896.769049:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185624960:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788529896.769425:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529896.770076:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529896.774094:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185624960 00000100:00100000:0.0:1788529896.774116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185624960 00000100:00100000:0.0:1788529896.774214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788529896.774228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875409185624960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788529896.774414:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875409185624960:12345-0@lo:1000:mdt00_000.0 Request processed in 188us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529896.774435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788529896.774705:0:5829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788529896.774713:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabf5fb2a00, transno 4294967315 00000100:00100000:1.0:1788529896.774740:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185624960:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788529896.775818:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788529896.775974:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185625088:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788529896.776040:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529896.776077:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f6bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529896.776150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185625088 00000100:00100000:3.0:1788529896.776159:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185625088 00000100:00100000:3.0:1788529896.776212:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529896.776222:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1875409185625088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788529896.776452:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875409185625088:12345-0@lo:1000:mdt00_000.0 Request processed in 231us (412us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788529896.776460:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529896.776504:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185625088:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788529896.776562:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776581:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776590:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776598:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529896.776614:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776626:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776647:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc5e09300) 00010000:00010000:3.0:1788529896.776651:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529896.776657:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776665:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243a00/0xaa46022e3f18bc49 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776703:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776710:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776716:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776723:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529896.776725:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776731:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776739:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:3.0:1788529896.776742:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529896.776753:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776759:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242e00/0xaa46022e3f18bb7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776786:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776805:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776816:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776845:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.776867:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 21 pid: 5830 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529896.776881:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185625216:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529896.776984:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529896.781241:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529896.781280:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158359040 00000100:00100000:1.0:1788529896.781290:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158359040 00010000:00010000:1.0:1788529896.781440:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 22 pid: 5830 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529896.781501:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1788529896.781511:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+22:2355:x1875409158359040:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529896.781544:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529896.781552:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 22 pid: 5830 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.781573:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 22 pid: 5830 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.781600:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:1.0:1788529896.781605:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.781617:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.781626:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529896.781649:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529896.781720:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+22:2355:x1875409158359040:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 210us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529896.781728:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00010000:00010000:1.0:1788529896.784361:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529896.786429:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bb9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da102c expref: 21 pid: 5830 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.786459:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185625216:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529896.786492:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786503:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786527:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786545:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786553:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786561:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786568:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529896.786574:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786582:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786601:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529896.786612:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788529896.786618:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786625:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786637:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786643:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786649:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786653:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529896.786656:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786661:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786669:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc5e09500) 00010000:00010000:0.0:1788529896.786672:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788529896.786674:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.786680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bc42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529896.787416:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:11548:x1875409158358784:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 48725us (48924us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788529896.787436:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 186 00000020:00080000:0.0:1788529896.787444:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788529896.787604:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788529896.787609:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788529896.791306:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788529896.791828:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788529896.797370:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529896.797569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158359296 00000100:00100000:3.0:1788529896.797583:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158359296 00000100:00100000:3.0:1788529896.797650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1788529896.797663:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:11548:x1875409158359296:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788529896.803699:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788529896.803825:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788529896.803958:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.803981:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.803996:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.804007:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.804015:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.804022:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529896.804053:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788529896.804209:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+22:11548:x1875409158359296:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 6542us (6849us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788529896.804222:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000020:00080000:3.0:1788529896.804230:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788529896.809672:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529896.809694:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.809709:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529896.809714:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.809727:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.809871:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cabc9230b00) 00010000:00010000:0.0:1788529896.809876:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788529896.809883:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.809890:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529896.809933:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529896.809935:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529896.809937:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529896.892954:0:12484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529896.892968:0:12484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529896.893022:0:12484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788529896.893029:0:12484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788529897.009134:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.009249:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158359552 00000100:00100000:3.0:1788529897.009259:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158359552 00000100:00100000:3.0:1788529897.009329:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:3.0:1788529897.009341:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+22:11558:x1875409158359552:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529897.009366:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529897.009386:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1064 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.009524:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.009539:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.009550:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529897.009560:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788529897.009946:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bc5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1064 expref: 25 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.009966:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1064 expref: 24 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.009975:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529897.009979:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529897.009983:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030600, rc 0) 00000100:00100000:3.0:1788529897.010043:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+24:11558:x1875409158359552:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 704us (916us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788529897.010051:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00080000:0.0:1788529897.010373:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788529897.014366:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.014629:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158359680 00000100:00100000:3.0:1788529897.014646:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158359680 00000100:00100000:3.0:1788529897.015064:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:3.0:1788529897.015078:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf61ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+24:11558:x1875409158359680:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1788529897.015203:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015240:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015256:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015274:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015282:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015289:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015635:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015645:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015654:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529897.015713:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015732:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015752:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015775:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015783:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.015788:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015798:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015815:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529897.015819:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.015826:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015834:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bc73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015853:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015860:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015872:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015876:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.015880:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015952:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015962:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230600) 00010000:00010000:3.0:1788529897.015965:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.015969:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015975:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bc7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.015995:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016002:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016010:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016016:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd6a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.016019:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016024:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016032:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc9230900) 00010000:00010000:3.0:1788529897.016036:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.016039:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.016055:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6a00/0xaa46022e3f18bc81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529897.016166:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf61ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+24:11558:x1875409158359680:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1089us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529897.016177:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:3.0:1788529897.046361:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788529897.046391:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc321d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185625344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529897.046489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529897.046593:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185625344 00000100:00100000:3.0:1788529897.046603:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185625344 00000100:00100000:3.0:1788529897.046677:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788529897.046689:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185625344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788529897.046757:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529897.046819:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875409185625344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529897.046827:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788529897.046888:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc321d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185625344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529897.074783:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.074839:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158359936 00000100:00100000:1.0:1788529897.074851:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158359936 00000100:00100000:1.0:1788529897.074949:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:1.0:1788529897.074962:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+24:11561:x1875409158359936:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529897.074986:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529897.075013:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bc88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da106b expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075086:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075102:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075116:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075135:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075143:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075149:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075422:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075431:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075449:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529897.075460:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788529897.075555:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075562:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075568:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075573:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.075577:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075584:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075595:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529897.075598:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.075602:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075607:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bc8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075617:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075623:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075634:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075639:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.075642:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075648:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075656:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc3837d00) 00010000:00010000:1.0:1788529897.075658:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.075661:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075674:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18bc96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075716:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bc88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 27 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075730:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 26 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.075736:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529897.075738:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529897.075740:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49a00, rc 0) 00000100:00100000:1.0:1788529897.075804:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+26:11561:x1875409158359936:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 845us (1030us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788529897.075819:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:2.0:1788529897.093248:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.093358:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158360064 00000100:00100000:1.0:1788529897.093370:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158360064 00000100:00100000:1.0:1788529897.093457:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1788529897.093467:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+26:11561:x1875409158360064:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1788529897.093564:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093584:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093598:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093633:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093641:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093648:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093653:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.093657:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093673:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093688:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529897.093705:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529897.093711:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.093719:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.093820:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+26:11561:x1875409158360064:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 348us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529897.093826:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1788529897.097300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.097384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158360320 00000100:00100000:2.0:1788529897.097398:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158360320 00000100:00100000:2.0:1788529897.097466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1788529897.097478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+26:11561:x1875409158360320:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1788529897.097823:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+27:11561:x1875409158360320:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 346us (537us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788529897.097831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1788529897.142848:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.142931:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158360576 00000100:00100000:1.0:1788529897.142947:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158360576 00000100:00100000:1.0:1788529897.143025:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:1.0:1788529897.143036:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+27:11096:x1875409158360576:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529897.143062:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529897.143083:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1072 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.143207:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.143223:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.143231:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.143268:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.143299:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 28 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.143315:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6125f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185625472:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529897.143412:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f6b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788529897.148561:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.148649:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158360704 00000100:00100000:0.0:1788529897.148661:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158360704 00010000:00010000:0.0:1788529897.148734:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 29 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.148786:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1788529897.148798:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+29:2354:x1875409158360704:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529897.148816:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529897.148824:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 29 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.148845:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 29 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.148874:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:0.0:1788529897.148888:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.148920:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.148929:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.148951:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529897.149024:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+29:2354:x1875409158360704:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 227us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.149032:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00010000:00010000:3.0:1788529897.149666:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bc9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da106b expref: 28 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529897.149695:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6125f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185625472:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529897.149734:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.149757:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.149764:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529897.149790:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788529897.155188:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bcb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 29 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.155223:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 28 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.155233:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:3.0:1788529897.155236:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529897.155240:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:3.0:1788529897.155329:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+28:11096:x1875409158360576:12345-192.168.201.52@tcp:101:bash.0 Request processed in 12294us (12495us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788529897.155339:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:1.0:1788529897.159613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.160090:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158360960 00000100:00100000:2.0:1788529897.160103:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158360960 00000100:00100000:2.0:1788529897.160265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:2.0:1788529897.160278:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+28:11096:x1875409158360960:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1788529897.160621:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.160641:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.160654:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788529897.160731:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788529897.160766:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097049f94 reply state 0000000038731b6f transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.160775:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788529897.160822:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788529897.160964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:11096:x1875409158360960:12345-192.168.201.52@tcp:36:bash.0 Request processed in 687us (1363us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788529897.160972:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000020:00080000:2.0:1788529897.160978:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788529897.170324:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170347:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170363:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170371:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.170377:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170386:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170408:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:2.0:1788529897.170412:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529897.170418:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.170426:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.172325:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.172382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361088 00000100:00100000:2.0:1788529897.172396:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361088 00000100:00100000:2.0:1788529897.172471:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:2.0:1788529897.172482:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+31:11096:x1875409158361088:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1788529897.172528:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529897.172555:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bcce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1079 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.172633:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bcce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1079 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.172662:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bcce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1079 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.172699:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:2.0:1788529897.172703:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788529897.172707:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100800, rc 0) 00000100:00100000:2.0:1788529897.172778:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+32:11096:x1875409158361088:12345-192.168.201.52@tcp:101:bash.0 Request processed in 297us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529897.172786:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:3.0:1788529897.185148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.185203:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361216 00000100:00100000:3.0:1788529897.185216:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361216 00000100:00100000:3.0:1788529897.185299:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1788529897.185311:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:11096:x1875409158361216:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529897.185335:0:12086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529897.185362:0:12086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1080 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788529897.185419:0:12086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9acce7, atime: 0x6a9acce5, ctime: 0x6a9acce7, blocks: 0xb 00010000:00010000:3.0:1788529897.185449:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1788529897.185454:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529897.185464:0:12086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.185485:0:12086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 8 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.185501:0:12086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd6a00, rc 0) 00000100:00100000:3.0:1788529897.185586:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+8:11096:x1875409158361216:12345-192.168.201.52@tcp:101:bash.0 Request processed in 278us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529897.185595:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00080000:3.0:1788529897.185623:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529897.191598:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.191804:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361344 00000100:00100000:2.0:1788529897.191817:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361344 00002000:00010000:2.0:1788529897.191872:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788529897.191878:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc321c380 with x1875409158361344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788529897.192045:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabc321c380. 00000100:00100000:2.0:1788529897.192130:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1788529897.192143:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158361344:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:2.0:1788529897.192491:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788529897.192495:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788529895 -> 1788529897 00002000:00010000:2.0:1788529897.192498:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788529893 -> 1788529893 00002000:00010000:2.0:1788529897.192500:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788529895 -> 1788529897 00002000:00010000:2.0:1788529897.192503:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788529897.192591:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158361344:12345-192.168.201.52@tcp:10:bash.0 Request processed in 449us (1008us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788529897.192599:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00002000:00010000:2.0:1788529897.192603:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788529897.192612:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc321c380 with x1875409158361344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788529897.192617:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabc321c380. 00000100:00100000:3.0:1788529897.247258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.252849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361472 00000100:00100000:1.0:1788529897.252872:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361472 00000100:00100000:2.0:1788529897.253155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:2.0:1788529897.253172:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:11575:x1875409158361472:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1788529897.253275:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253312:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253329:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253336:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253343:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253686:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253698:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253706:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529897.253756:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253780:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253788:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253797:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253803:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.253808:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253817:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253831:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529897.253835:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529897.253841:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253848:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18bcdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253863:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.253869:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254756:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254781:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.254785:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254793:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254805:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc8c54900) 00010000:00010000:2.0:1788529897.254808:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529897.254811:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254818:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101200/0xaa46022e3f18bce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254841:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254848:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254855:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254860:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.254863:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.254870:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.256137:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:2.0:1788529897.256140:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529897.256148:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.256155:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18bcea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529897.261221:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:11575:x1875409158361472:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 8034us (13957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529897.261240:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:1.0:1788529897.305031:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.305113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361728 00000100:00100000:2.0:1788529897.305128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361728 00000100:00100000:3.0:1788529897.305302:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:3.0:1788529897.305319:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+32:11579:x1875409158361728:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529897.305351:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529897.305380:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bcf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1087 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305524:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305545:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305558:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305576:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305585:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.305591:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306086:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bd06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306098:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306105:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529897.306116:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788529897.306234:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306243:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306257:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306264:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.306270:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306278:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306292:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529897.306296:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.306301:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306309:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bcf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306323:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306329:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306336:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306342:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.306345:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306360:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306368:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529897.306370:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.306372:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306377:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bcff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306428:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bcf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1087 expref: 35 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306444:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bd06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1087 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.306453:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:3.0:1788529897.306455:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788529897.306458:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031400, rc 0) 00000100:00100000:3.0:1788529897.306553:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+34:11579:x1875409158361728:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1238us (1539us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788529897.306562:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1788529897.310337:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.311067:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158361856 00000100:00100000:1.0:1788529897.311079:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158361856 00000100:00100000:1.0:1788529897.311351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:1.0:1788529897.311362:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+34:11579:x1875409158361856:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1788529897.311451:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.311468:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.311477:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.311526:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 34 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.311551:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 34 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.311587:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6127100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185625600:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529897.313210:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3f6bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529897.316147:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6127100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185625600:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529897.316186:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.317823:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.318057:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158362112 00000100:00100000:0.0:1788529897.318082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158362112 00000100:00100000:0.0:1788529897.318162:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1788529897.318175:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:5597:x1875409158362112:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788529897.318649:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+36:5597:x1875409158362112:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 476us (834us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788529897.318658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1788529897.321329:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.321562:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158362240 00000100:00100000:1.0:1788529897.321575:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158362240 00010000:00010000:1.0:1788529897.321632:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 36 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.321681:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1788529897.321693:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+36:2355:x1875409158362240:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529897.321723:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529897.321732:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 36 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.321958:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 36 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.321988:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bcb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1072 expref: 36 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.322008:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529897.322014:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.322043:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.322052:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.322082:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529897.322294:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322304:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322342:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322351:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322358:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322364:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529897.322369:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322377:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322387:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:0.0:1788529897.322390:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788529897.322402:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.322408:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bd14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.322471:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+35:2355:x1875409158362240:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 779us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529897.322480:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1788529897.322678:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+34:11579:x1875409158361856:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 11317us (12356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.322689:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1788529897.325615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.325835:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158362496 00000100:00100000:0.0:1788529897.325849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158362496 00000100:00100000:0.0:1788529897.326050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1788529897.326063:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+34:11579:x1875409158362496:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529897.326396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+35:11579:x1875409158362496:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 335us (793us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788529897.326404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1788529897.392625:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.392879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158362752 00000100:00100000:0.0:1788529897.392936:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158362752 00000100:00100000:0.0:1788529897.393014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:0.0:1788529897.393026:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+35:11590:x1875409158362752:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1788529897.393061:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529897.393089:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bd1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da108e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393425:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393443:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393457:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393473:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393481:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393487:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.393983:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bd30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394010:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bd30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394018:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bd30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529897.394032:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788529897.394211:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394219:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394226:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394231:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.394236:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394243:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394257:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529897.394260:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.394266:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394272:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394284:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394296:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394302:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394307:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.394310:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394316:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394322:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc3837b00) 00010000:00010000:1.0:1788529897.394324:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.394327:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394333:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394386:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243e00/0xaa46022e3f18bd1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da108e expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394402:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bd30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da108e expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.394411:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:1.0:1788529897.394413:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529897.394421:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529897.400414:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+37:11590:x1875409158362752:12345-192.168.201.52@tcp:101:cat.0 Request processed in 1482us (1897us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788529897.400432:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:2.0:1788529897.406830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.407262:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363008 00000100:00100000:3.0:1788529897.407278:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363008 00000100:00100000:3.0:1788529897.407353:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1788529897.407365:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+37:11590:x1875409158363008:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1788529897.407987:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+38:11590:x1875409158363008:12345-192.168.201.52@tcp:35:cat.0 Request processed in 623us (1172us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788529897.407995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1788529897.428642:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.429541:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363264 00000100:00100000:3.0:1788529897.429556:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363264 00000100:00100000:3.0:1788529897.429638:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:3.0:1788529897.429650:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+38:11591:x1875409158363264:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:3.0:1788529897.429748:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788529897.429783:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bd30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da108e expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429807:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bd06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1087 expref: 37 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429823:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bcce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1079 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429834:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc3837000) 00010000:00010000:3.0:1788529897.429848:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529897.429873:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429920:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429933:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429971:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429979:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.429986:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.430277:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.430286:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.430293:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788529897.431850:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788529897.431864:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407401969695ns, next at 408401965501ns, rc = 0 00010000:00010000:1.0:1788529897.431988:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432006:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432019:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432029:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432036:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432044:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432074:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788529897.432101:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432107:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432113:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432136:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.432141:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432149:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432162:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc9230800) 00010000:00010000:1.0:1788529897.432165:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788529897.432170:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432176:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bd4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432201:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432206:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432212:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432216:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.432219:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432224:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432244:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529897.432246:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.432249:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.432256:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18bd3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788529897.432270:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090e1aa1b reply state 00000000cbcd0a26 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.432280:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788529897.432398:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+37:11591:x1875409158363264:12345-192.168.201.52@tcp:36:rm.0 Request processed in 2744us (3766us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788529897.432408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00010000:00010000:2.0:1788529897.432662:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529897.432670:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.432677:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529897.432680:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.432687:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.432696:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cabc9230800) 00010000:00010000:2.0:1788529897.432699:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788529897.432720:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.432727:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.432750:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529897.432752:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529897.432754:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529897.436656:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436679:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436687:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436695:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529897.436701:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436749:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436769:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529897.436772:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529897.436778:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.436786:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18bd45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.519154:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529897.519364:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363520 00000100:00100000:3.0:1788529897.519388:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363520 00000100:00100000:3.0:1788529897.519478:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:3.0:1788529897.519493:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+36:11597:x1875409158363520:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788529897.519564:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529897.519593:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bd5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1095 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.519881:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.520015:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.520031:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.520463:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.520473:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.520482:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788529897.522164:0:7603:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788529897.522403:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522423:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522435:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522477:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522483:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522509:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522516:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.522522:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522531:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522550:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529897.522553:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529897.522559:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522567:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bd61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788529897.522585:0:7603:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a42db31c reply state 00000000cd9013f6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.522595:0:7603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788529897.522641:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bd5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 39 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522657:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 38 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.522665:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:2.0:1788529897.522667:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529897.522673:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100600, rc 0) 00000100:00100000:2.0:1788529897.522784:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+39:11597:x1875409158363520:12345-192.168.201.52@tcp:101:bash.0 Request processed in 3295us (3647us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788529897.522794:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:2.0:1788529897.526880:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.526994:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363648 00000100:00100000:0.0:1788529897.527008:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363648 00000100:00100000:0.0:1788529897.527091:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1788529897.527105:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158363648:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529897.527160:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529897.527187:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da109c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529897.527222:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529897.527249:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1788529897.527255:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.527267:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.527291:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.527309:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243c00, rc 0) 00000100:00100000:0.0:1788529897.527388:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158363648:12345-192.168.201.52@tcp:101:bash.0 Request processed in 276us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.527396:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00010000:00010000:1.0:1788529897.527952:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.527965:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.527972:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.527980:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529897.527986:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.527994:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.528024:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc8c54900) 00010000:00010000:1.0:1788529897.528028:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529897.528033:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.528041:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100800/0xaa46022e3f18bd68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788529897.528355:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529897.533374:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.533552:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363776 00000100:00100000:0.0:1788529897.533567:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363776 00000100:00100000:0.0:1788529897.533640:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1788529897.533652:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:11597:x1875409158363776:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529897.533675:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529897.533698:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.533754:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.533783:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.533788:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.533794:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.533839:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.533858:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.533875:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875409185625728:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529897.534032:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabdd6a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529897.536819:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875409185625728:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529897.536863:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.536890:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243600, rc 0) 00000100:00100000:0.0:1788529897.537001:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:11597:x1875409158363776:12345-192.168.201.52@tcp:101:bash.0 Request processed in 3352us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.537012:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1788529897.539653:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.539985:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158363904 00000100:00100000:0.0:1788529897.539999:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158363904 00010000:00010000:0.0:1788529897.540055:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.540182:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:0.0:1788529897.540194:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158363904:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529897.540216:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529897.540246:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.540266:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.540295:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bd7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da109c expref: 7 pid: 6689 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.540318:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.540322:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.540333:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.540343:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.540389:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.540408:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1875409185625856:192.168.201.52@tcp:105: 00000100:00100000:0.0:1788529897.540533:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabdd6a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529897.542600:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1875409185625856:192.168.201.52@tcp:105: 00010000:00010000:0.0:1788529897.542631:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529897.542748:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+6:2355:x1875409158363904:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2555us (3109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.542760:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1788529897.545631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.546302:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158364160 00000100:00100000:0.0:1788529897.546315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158364160 00000100:00100000:0.0:1788529897.546382:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1788529897.546395:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+38:11597:x1875409158364160:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1788529897.547357:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+39:11597:x1875409158364160:12345-192.168.201.52@tcp:35:bash.0 Request processed in 959us (1732us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788529897.547364:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1788529897.743867:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.744260:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158364288 00000100:00100000:1.0:1788529897.744273:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158364288 00000100:00100000:1.0:1788529897.744366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:1.0:1788529897.744387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+39:11613:x1875409158364288:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529897.744419:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529897.744450:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10aa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744574:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744593:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744608:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529897.744650:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788529897.744654:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529897.744782:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744828:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10aa expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744845:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10aa expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.744852:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529897.744854:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788529897.744858:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788529897.745008:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+40:11613:x1875409158364288:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 634us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529897.745015:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:2.0:1788529897.754178:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.754248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158364544 00000100:00100000:1.0:1788529897.754262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158364544 00000100:00100000:1.0:1788529897.754337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:1.0:1788529897.754360:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+40:11613:x1875409158364544:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529897.754397:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529897.754425:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10b1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.754576:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bda0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.754596:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.754621:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529897.754656:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788529897.754824:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bd99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b1 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.754845:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bda0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b1 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.754855:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:1.0:1788529897.754858:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529897.754863:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529897.754990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+42:11613:x1875409158364544:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 632us (822us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788529897.754997:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:3.0:1788529897.761444:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.761943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158364800 00000100:00100000:1.0:1788529897.761957:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158364800 00000100:00100000:1.0:1788529897.762029:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:1.0:1788529897.762040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+42:11613:x1875409158364800:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529897.762084:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529897.762176:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.762747:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.762768:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.762799:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529897.762816:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788529897.763030:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b8 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.763071:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b8 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.763080:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:1.0:1788529897.763084:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788529897.763088:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48200, rc 0) 00000100:00100000:1.0:1788529897.763511:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+44:11613:x1875409158364800:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1453us (2145us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788529897.763522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 00010000:00010000:0.0:1788529897.808702:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529897.818977:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.819253:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158364928 00000100:00100000:0.0:1788529897.819268:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158364928 00000100:00100000:0.0:1788529897.819358:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788529897.819377:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+44:2357:x1875409158364928:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529897.819398:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529897.819430:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48e00/0xaa46022e3f18bda0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b1 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.819882:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:0.0:1788529897.819890:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529897.820002:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+43:2357:x1875409158364928:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 633us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.820032:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1788529897.832653:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.832966:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365056 00000100:00100000:0.0:1788529897.832981:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365056 00000100:00100000:0.0:1788529897.833067:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1788529897.833081:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+6:2356:x1875409158365056:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:0.0:1788529897.833163:0:12087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.833191:0:12087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.833202:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529897.833208:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788529897.833214:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.833269:0:12087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.833296:0:12087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 6 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.833316:0:12087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875409185625984:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529897.833591:0:12087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabdd6a59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529897.838010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.838147:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365184 00000100:00100000:1.0:1788529897.838163:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365184 00002000:00100000:1.0:1788529897.838237:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cabf5864380 x1875409158365184/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:593/0 lens 504/0 e 0 to 0 dl 1788529908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788529897.838251:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf5864380 with x1875409158365184 ext(0->8) 00010000:00010000:1.0:1788529897.838263:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 7 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.838292:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 7 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529897.838327:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabf5864380 00000100:00100000:1.0:1788529897.839165:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1788529897.839187:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158365184:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:1.0:1788529897.840765:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2355:x1875409158365184:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 1571us (2757us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788529897.840779:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1788529897.840789:0:12087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875409185625984:192.168.201.52@tcp:104: 00002000:00100000:1.0:1788529897.840794:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cabf5864380 x1875409158365184/t4294967308(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:593/0 lens 504/448 e 0 to 0 dl 1788529908 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788529897.840806:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabf5864380 with x1875409158365184 ext(0->8) 00010000:00010000:1.0:1788529897.840818:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.840834:0:12087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.840845:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788529897.840854:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cabf5864380 00000100:00100000:2.0:1788529897.848085:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.848236:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365312 00000100:00100000:1.0:1788529897.848252:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365312 00010000:00010000:1.0:1788529897.848309:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.848365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:1.0:1788529897.848388:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+9:2354:x1875409158365312:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529897.848437:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788529897.848467:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788529897.848471:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788529897 00002000:00010000:1.0:1788529897.848475:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788529897 00002000:00010000:1.0:1788529897.848478:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788529897 00010000:00010000:1.0:1788529897.848486:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.848543:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.848575:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18bd84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10a3 expref: 9 pid: 6687 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.848598:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529897.848603:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529897.848611:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.848623:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.848661:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529897.848769:0:12087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848782:0:12087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848813:0:12087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848824:0:12087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848833:0:12087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848840:0:12087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529897.848846:0:12087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848857:0:12087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848871:0:12087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.848888:0:12087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18bdc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.849214:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158365312:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 835us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529897.849224:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:0.0:1788529897.849650:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158365056:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 16570us (17010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.849661:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1788529897.858608:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529897.858730:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365568 00000100:00100000:1.0:1788529897.858752:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365568 00000100:00100000:1.0:1788529897.858866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1788529897.858879:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+43:11613:x1875409158365568:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:1.0:1788529897.859001:0:5832:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b8 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788529897.859794:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788529897.859868:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788529897.861435:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788529897.861555:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.861581:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 47 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.861592:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.861644:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 47 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529897.861668:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 47 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529897.861686:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6124e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875409185626112:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529897.861828:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd113c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788529897.875067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.875395:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365696 00000100:00100000:0.0:1788529897.875412:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365696 00010000:00010000:0.0:1788529897.875475:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 48 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529897.875534:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1788529897.875546:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+48:2354:x1875409158365696:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529897.875567:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529897.875576:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 48 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.875598:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 48 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.875628:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:0.0:1788529897.875635:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.875647:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.875680:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529897.875703:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529897.875783:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+48:2354:x1875409158365696:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 239us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.875791:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00010000:00010000:3.0:1788529897.878019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100600/0xaa46022e3f18bd6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1095 expref: 47 pid: 7603 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529897.878048:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6124e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875409185626112:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529897.878080:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.878091:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529897.878103:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788529897.878284:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788529897.881552:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788529897.881790:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6083100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185626240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788529897.881888:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529897.881956:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529897.883180:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185626240 00000100:00100000:0.0:1788529897.883196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185626240 00000100:00100000:0.0:1788529897.883282:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788529897.883294:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875409185626240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788529897.883455:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875409185626240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529897.883463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529897.883937:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6083100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185626240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788529897.888244:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788529897.889935:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5865c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185626368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788529897.890033:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529897.890076:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcbdaa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529897.890475:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185626368 00000100:00100000:0.0:1788529897.890486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185626368 00000100:00100000:0.0:1788529897.890585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788529897.890599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875409185626368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788529897.890934:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1875409185626368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 338us (900us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788529897.890944:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788529897.892078:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5865c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875409185626368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788529897.892265:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788529897.893031:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893046:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893053:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893060:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788529897.893065:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893094:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893124:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:2.0:1788529897.893128:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788529897.893135:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.893142:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bdca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788529897.895251:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788529897.896257:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788529897.896279:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407866383890ns, next at 408866376827ns, rc = 0 00000001:00080000:2.0:1788529897.896294:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788529897.896731:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54000) 00010000:00010000:2.0:1788529897.896737:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788529897.896754:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bdb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10b8 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529897.896969:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+50:11613:x1875409158365568:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 38091us (38375us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788529897.896981:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000020:00080000:2.0:1788529897.896989:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788529897.902230:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529897.902357:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158365824 00000100:00100000:2.0:1788529897.902371:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158365824 00000100:00100000:2.0:1788529897.902450:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:2.0:1788529897.902463:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+50:11613:x1875409158365824:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788529897.902518:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529897.902551:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18bdd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10bf expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.902636:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18bdd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10bf expref: 51 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.902655:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18bdd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10bf expref: 51 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529897.902678:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529897.902682:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788529897.902687:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100a00, rc 0) 00000100:00100000:2.0:1788529897.906114:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+51:11613:x1875409158365824:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 3633us (3881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529897.906131:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:2.0:1788529897.915188:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529897.916030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158366080 00000100:00100000:0.0:1788529897.916046:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158366080 00000100:00100000:0.0:1788529897.916224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1788529897.916238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+51:11613:x1875409158366080:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1788529897.917272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+52:11613:x1875409158366080:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 1031us (2162us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788529897.917302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:0.0:1788529898.035732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.035953:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158366208 00000100:00100000:1.0:1788529898.035968:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158366208 00000100:00100000:1.0:1788529898.036044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:1.0:1788529898.036056:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:11623:x1875409158366208:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1788529898.036174:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036197:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036214:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036232:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036240:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036248:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036392:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036402:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036410:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788529898.036466:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036511:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036518:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036526:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036532:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.036537:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036546:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036562:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529898.036565:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.036570:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036578:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18bdd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036594:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036600:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036606:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036618:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.036622:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036628:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036637:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc3837b00) 00010000:00010000:1.0:1788529898.036639:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.036642:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036649:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18bddf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036665:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036670:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036677:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036682:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.036685:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036691:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036709:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.036712:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.036715:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.036722:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18bde6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.036824:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+52:11623:x1875409158366208:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 767us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.036832:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:1.0:1788529898.080259:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.080477:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158366464 00000100:00100000:3.0:1788529898.080524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158366464 00000100:00100000:3.0:1788529898.080610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:3.0:1788529898.080624:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+52:11626:x1875409158366464:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529898.080653:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.080702:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bded lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080814:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080832:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080846:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080861:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080868:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.080875:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081067:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081075:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081080:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.081091:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788529898.081442:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081462:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081469:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081476:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.081481:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081489:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081516:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529898.081519:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529898.081525:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081531:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bdf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081548:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081553:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081560:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081565:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.081573:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081579:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529898.081588:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529898.081590:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081595:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18bdfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081641:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bded lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081655:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.081662:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.081664:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529898.081667:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030e00, rc 0) 00000100:00100000:3.0:1788529898.081756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+54:11626:x1875409158366464:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1134us (1512us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788529898.081763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:2.0:1788529898.085037:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.085153:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158366592 00000100:00100000:1.0:1788529898.085167:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158366592 00000100:00100000:1.0:1788529898.085244:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:1.0:1788529898.085256:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:11626:x1875409158366592:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1788529898.085369:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085391:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085405:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085437:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085445:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085469:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085476:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.085481:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085501:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085518:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.085521:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788529898.085527:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.085534:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.085640:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:11626:x1875409158366592:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 385us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.085649:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:2.0:1788529898.088448:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.088623:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158366848 00000100:00100000:1.0:1788529898.088638:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158366848 00000100:00100000:1.0:1788529898.088733:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1788529898.088746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+54:11626:x1875409158366848:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788529898.089107:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:11626:x1875409158366848:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 362us (669us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788529898.089117:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1788529898.181707:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529898.181863:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158367104 00000100:00100000:0.0:1788529898.181876:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158367104 00000100:00100000:0.0:1788529898.181979:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:0.0:1788529898.181995:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+55:11636:x1875409158367104:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788529898.182030:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529898.182034:0:7603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788529898.182067:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bd92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10aa expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182109:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:0.0:1788529898.182116:0:7603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529898.182135:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18be17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10cd expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182265:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182280:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182288:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182330:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.182382:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 55 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529898.182400:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185626496:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529898.182560:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabdd6a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529898.185187:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185626496:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529898.185224:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529898.186843:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529898.186961:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158367232 00000100:00100000:0.0:1788529898.186973:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158367232 00010000:00010000:0.0:1788529898.187023:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 56 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529898.187071:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1788529898.187082:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+56:2355:x1875409158367232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529898.187101:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529898.187115:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 56 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187135:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 56 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187161:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10c6 expref: 56 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187202:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:0.0:1788529898.187208:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187217:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187226:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.187264:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529898.187325:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:2355:x1875409158367232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 244us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529898.187332:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00010000:00010000:3.0:1788529898.187410:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.187420:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.187452:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788529898.187680:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243000/0xaa46022e3f18be17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 56 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.187697:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 55 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.187705:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.187707:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529898.187710:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242a00, rc 0) 00000100:00100000:3.0:1788529898.187738:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+55:11636:x1875409158367104:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5750us (6048us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788529898.187746:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:3.0:1788529898.191393:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.191536:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158367488 00000100:00100000:1.0:1788529898.191548:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158367488 00000100:00100000:1.0:1788529898.191633:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:1.0:1788529898.191646:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+55:11636:x1875409158367488:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:1.0:1788529898.192324:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.192345:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.192360:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788529898.192425:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788529898.192453:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009343e131 reply state 00000000f48acb78 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.192464:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788529898.192968:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+58:11636:x1875409158367488:12345-192.168.201.52@tcp:36:bash.0 Request processed in 1321us (1588us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788529898.192977:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 208 00000020:00080000:1.0:1788529898.192982:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788529898.197241:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1788529898.197372:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197388:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197397:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197404:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.197410:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197419:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197463:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.197466:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529898.197473:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.197481:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.197887:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158367616 00000100:00100000:1.0:1788529898.198004:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158367616 00000100:00100000:1.0:1788529898.198099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:1.0:1788529898.198121:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:11636:x1875409158367616:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788529898.198152:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529898.198175:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18be33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.198296:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.198312:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 58 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.198322:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.198370:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 58 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.198394:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 58 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.198410:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185626624:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529898.198526:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd113cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529898.203447:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.203672:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158367744 00000100:00100000:3.0:1788529898.203685:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158367744 00010000:00010000:3.0:1788529898.203837:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 59 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529898.203915:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:3.0:1788529898.203927:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:2354:x1875409158367744:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529898.203945:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529898.203952:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 59 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.203972:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 59 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.204002:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.204008:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.204020:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.204051:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.204074:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529898.204240:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18be1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10cd expref: 59 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.204260:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185626624:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529898.204289:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.204312:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.204332:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529898.204397:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788529898.204403:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529898.204430:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.204466:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18be33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.204483:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.204503:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.204506:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529898.204509:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:3.0:1788529898.205310:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:2354:x1875409158367744:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1378us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.205324:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:1.0:1788529898.205413:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+57:11636:x1875409158367616:12345-192.168.201.52@tcp:101:bash.0 Request processed in 7294us (8184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.205421:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:2.0:1788529898.209595:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.209681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368000 00000100:00100000:1.0:1788529898.209696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368000 00000100:00100000:1.0:1788529898.209773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1788529898.209785:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+57:11636:x1875409158368000:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1788529898.210120:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+58:11636:x1875409158368000:12345-192.168.201.52@tcp:35:bash.0 Request processed in 336us (538us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788529898.210129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1788529898.277775:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.277962:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368128 00000100:00100000:3.0:1788529898.277976:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368128 00000100:00100000:3.0:1788529898.278097:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:3.0:1788529898.278214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+58:11642:x1875409158368128:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529898.278246:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.278277:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18be41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278361:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278379:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278393:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.278439:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788529898.278444:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529898.278466:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278530:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031000/0xaa46022e3f18be41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10db expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278554:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10db expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.278563:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529898.278566:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529898.278572:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031400, rc 0) 00000100:00100000:3.0:1788529898.278656:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158368128:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 447us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.278663:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:2.0:1788529898.281777:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.282423:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368256 00000100:00100000:3.0:1788529898.282437:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368256 00000100:00100000:3.0:1788529898.282585:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:3.0:1788529898.282598:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158368256:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529898.282627:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.282656:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10e2 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282781:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282799:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282811:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282833:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282841:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282848:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282976:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282985:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.282991:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.283033:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788529898.283037:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529898.283057:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283069:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283078:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283300:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283318:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283324:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.283328:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283336:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283351:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529898.283355:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529898.283360:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283367:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18be56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283383:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283390:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283396:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283401:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.283403:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283418:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283426:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529898.283428:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529898.283431:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283437:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283470:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18be4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283484:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 60 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.283503:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.283505:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529898.283507:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:3.0:1788529898.283588:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+60:11642:x1875409158368256:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 992us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.283597:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:2.0:1788529898.288006:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529898.288136:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.288272:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368640 00000100:00100000:1.0:1788529898.288287:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368640 00000100:00100000:1.0:1788529898.288360:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:1.0:1788529898.288374:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:11642:x1875409158368640:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788529898.288406:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529898.288434:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18be6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10e9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288585:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288602:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288612:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288634:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288681:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288702:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.288737:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185626752:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529898.288872:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.288939:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 61 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.288950:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6126680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185626880:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529898.288981:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd113cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529898.294385:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:1.0:1788529898.294470:0:5829:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.52@tcp) returned -22 from blocking AST (req@000000006be10846 x1875409185626752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.294514:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.294543:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18be64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e2 expref: 61 pid: 7603 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.294562:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185626752:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788529898.294575:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6126680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185626880:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529898.294607:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.294613:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.294623:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.294634:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529898.295279:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368512 00000100:00100000:0.0:1788529898.295291:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368512 00000100:00100000:1.0:1788529898.295376:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158368768 00000100:00100000:1.0:1788529898.295380:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158368768 00010000:00010000:1.0:1788529898.295399:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 62 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.295442:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1788529898.295452:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+62:2354:x1875409158368768:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529898.295472:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529898.295478:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 62 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295501:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 62 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295518:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10d4 expref: 62 pid: 5831 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295531:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.295535:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295545:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295554:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.295590:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529898.295663:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+61:2354:x1875409158368768:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 211us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.295672:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1788529898.295692:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1788529898.295700:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+60:2355:x1875409158368512:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529898.295725:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529898.295729:0:5816:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie aa46022e3f18be64) 00010000:00010000:1.0:1788529898.295731:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529898.295750:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+60:2355:x1875409158368512:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 52us (7761us total) trans 0 rc 116/116 00000100:00100000:1.0:1788529898.295756:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:3.0:1788529898.295975:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.295985:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.296021:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788529898.296243:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18be6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 61 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.296262:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.296269:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.296272:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788529898.296275:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:3.0:1788529898.296304:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:11642:x1875409158368640:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 7934us (8168us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788529898.296311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:3.0:1788529898.299376:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.299877:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369024 00000100:00100000:3.0:1788529898.299923:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369024 00000100:00100000:3.0:1788529898.300005:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788529898.300018:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+60:11642:x1875409158369024:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:3.0:1788529898.300039:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529898.300072:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100a00/0xaa46022e3f18bdd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10bf expref: 60 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.300115:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.300122:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529898.300204:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158369024:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 188us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.300234:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1788529898.303192:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.303284:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369152 00000100:00100000:1.0:1788529898.303297:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369152 00000100:00100000:1.0:1788529898.303389:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:1.0:1788529898.303401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158369152:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:1.0:1788529898.303542:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.303560:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.303574:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788529898.303853:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788529898.303988:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158369152:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 587us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.303996:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:2.0:1788529898.306536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.306637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369280 00000100:00100000:3.0:1788529898.306650:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369280 00000100:00100000:3.0:1788529898.306868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 214 00000100:00100000:3.0:1788529898.306881:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+59:11642:x1875409158369280:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529898.306941:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.306970:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307045:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307057:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307090:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307208:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307226:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.307229:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529898.307232:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.307239:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7800, rc 0) 00000100:00100000:3.0:1788529898.307366:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+60:11642:x1875409158369280:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 487us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.307374:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 214 00010000:00010000:0.0:1788529898.829053:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529898.829639:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529898.829646:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529898.829695:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788529898.829701:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529898.830371:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185627008:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788529898.833627:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabcbdaa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788529898.856201:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.856324:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369408 00000100:00100000:3.0:1788529898.856336:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369408 00000100:00100000:3.0:1788529898.856414:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:3.0:1788529898.856428:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158369408:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788529898.856474:0:7603:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788529898.856635:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158369408:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 210us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.856643:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:0.0:1788529898.861032:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185627008:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788529898.864632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.865689:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369536 00000100:00100000:1.0:1788529898.865705:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369536 00000100:00100000:1.0:1788529898.865797:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:1.0:1788529898.865809:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:11643:x1875409158369536:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788529898.865971:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.865994:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866009:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866030:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866038:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866046:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866074:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866085:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866092:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529898.866147:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788529898.866174:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788529898.866194:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866208:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866216:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866225:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866232:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.866238:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866247:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866264:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:1.0:1788529898.866267:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.866272:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866279:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18be8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866296:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866302:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866321:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866327:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.866331:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866337:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866346:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cabc3837b00) 00010000:00010000:1.0:1788529898.866349:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.866352:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866358:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18be95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866377:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866384:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866390:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866396:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.866399:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866417:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866427:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529898.866430:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.866434:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.866440:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18be9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.866563:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+60:11643:x1875409158369536:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 748us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.866573:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:2.0:1788529898.871684:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.871850:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369792 00000100:00100000:3.0:1788529898.871866:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369792 00000100:00100000:3.0:1788529898.871973:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:3.0:1788529898.871985:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+60:11643:x1875409158369792:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529898.872013:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.872042:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bea3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10f7 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872322:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872341:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872355:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529898.872391:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788529898.872530:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872540:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872547:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872554:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529898.872559:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872569:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872585:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529898.872589:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788529898.872594:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872601:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18beaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872653:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bea3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f7 expref: 62 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872665:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:3.0:1788529898.872668:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529898.872680:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bea3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f7 expref: 62 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.872692:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7e00, rc 0) 00000100:00100000:3.0:1788529898.877600:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158369792:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 5596us (5912us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788529898.877617:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:2.0:1788529898.891252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.891677:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158369920 00000100:00100000:1.0:1788529898.891692:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158369920 00000100:00100000:1.0:1788529898.891783:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 218 00000100:00100000:1.0:1788529898.891795:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158369920:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788529898.891870:0:5829:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788529898.892060:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158369920:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 266us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.892068:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 218 00000100:00100000:2.0:1788529898.899206:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.900012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158370176 00000100:00100000:1.0:1788529898.900029:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158370176 00000100:00100000:1.0:1788529898.900126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:1.0:1788529898.900140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158370176:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529898.900170:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529898.900184:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788529898.900217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18be48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10db expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.900244:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529898.900251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529898.900269:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18beb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da10fe expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788529898.900850:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788529898.901172:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.901190:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.901201:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.901263:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18beb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10fe expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.901279:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10fe expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.901287:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc3837b00) 00010000:00010000:1.0:1788529898.901290:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788529898.901293:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788529898.901774:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+62:11643:x1875409158370176:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1636us (2583us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788529898.901797:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:2.0:1788529898.905227:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.905317:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158370432 00000100:00100000:1.0:1788529898.905332:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158370432 00000100:00100000:1.0:1788529898.905418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:1.0:1788529898.905429:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+62:11643:x1875409158370432:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788529898.905524:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529898.905572:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10fe expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905595:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc3837b00) 00010000:00010000:1.0:1788529898.905609:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529898.905641:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905661:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905673:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905692:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905699:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905705:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905823:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905831:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905838:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905845:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.905850:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905860:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905871:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:1.0:1788529898.905874:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.905879:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905885:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48000/0xaa46022e3f18becd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905943:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905950:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905956:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905968:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.905971:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905977:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905986:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe19a1a71 (ffff8cabc3837d00) 00010000:00010000:1.0:1788529898.905988:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788529898.905991:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.905997:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48200/0xaa46022e3f18bed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe19a1a71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529898.906102:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158370432:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 673us (893us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529898.906110:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:2.0:1788529898.908649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.908802:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158370560 00000100:00100000:3.0:1788529898.908816:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158370560 00000100:00100000:3.0:1788529898.908889:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:3.0:1788529898.908958:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+61:11643:x1875409158370560:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529898.908988:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.909021:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bedb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1105 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909064:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909080:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909105:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909234:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 63 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909257:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 62 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.909278:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529898.909281:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788529898.909285:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabd2bd7c00, rc 0) 00000100:00100000:3.0:1788529898.909354:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+62:11643:x1875409158370560:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 400us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.909361:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:2.0:1788529898.920077:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.920454:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158370816 00000100:00100000:3.0:1788529898.920468:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158370816 00000100:00100000:3.0:1788529898.922363:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:3.0:1788529898.922394:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+62:11643:x1875409158370816:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529898.922542:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.922566:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.922581:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529898.922960:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788529898.922972:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408893077393ns, next at 409893075115ns, rc = 0 00000004:00010000:3.0:1788529898.923082:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000038a93d reply state 00000000eb1d8c25 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529898.923093:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529898.923243:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+64:11643:x1875409158370816:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 864us (3180us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788529898.923274:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:2.0:1788529898.934717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529898.935202:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158370944 00000100:00100000:3.0:1788529898.935216:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158370944 00000100:00100000:3.0:1788529898.935305:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:3.0:1788529898.935318:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+64:11643:x1875409158370944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788529898.935366:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529898.935396:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da110c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.935486:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 65 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.935504:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 65 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529898.935527:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529898.935531:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788529898.935535:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031400, rc 0) 00000100:00100000:3.0:1788529898.935612:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+65:11643:x1875409158370944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 296us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529898.935620:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 223 00010000:00010000:1.0:1788529898.936875:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.936938:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.936949:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.936956:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529898.936962:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.936997:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.937015:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:1.0:1788529898.937018:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788529898.937025:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529898.937031:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7e00/0xaa46022e3f18bee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529898.943170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529898.943358:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158371072 00000100:00100000:0.0:1788529898.943371:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158371072 00000100:00100000:0.0:1788529898.943455:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1788529898.943468:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2357:x1875409158371072:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788529898.943954:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+10:2357:x1875409158371072:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 487us (798us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788529898.943963:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1788529898.951727:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.951851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158371328 00000100:00100000:1.0:1788529898.951866:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158371328 00000100:00100000:1.0:1788529898.951985:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:1.0:1788529898.951999:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+64:11643:x1875409158371328:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788529898.952353:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+65:11643:x1875409158371328:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 356us (653us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788529898.952362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1788529898.966173:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.966338:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158371584 00000100:00100000:1.0:1788529898.966352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158371584 00000100:00100000:1.0:1788529898.966434:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 224 00000100:00100000:1.0:1788529898.966447:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+65:11643:x1875409158371584:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788529898.966608:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+65:11643:x1875409158371584:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 164us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.966618:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 224 00000100:00100000:3.0:1788529898.984956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529898.985103:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158371712 00000100:00100000:0.0:1788529898.985136:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158371712 00000100:00100000:0.0:1788529898.985220:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:0.0:1788529898.985233:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+65:11643:x1875409158371712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529898.985261:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529898.985290:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242000/0xaa46022e3f18bef7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1113 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985386:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985404:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985417:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529898.985466:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529898.985501:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985532:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242000/0xaa46022e3f18bef7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1113 expref: 67 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985552:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1113 expref: 66 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529898.985561:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:0.0:1788529898.985564:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788529898.985569:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243400, rc 0) 00000100:00100000:0.0:1788529898.985657:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+66:11643:x1875409158371712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 427us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529898.985671:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:0.0:1788529898.993955:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529898.994089:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158371840 00000100:00100000:2.0:1788529898.994117:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158371840 00000100:00100000:2.0:1788529898.994216:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1788529898.994229:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+10:2354:x1875409158371840:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788529898.994264:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529898.994293:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da111a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788529898.994363:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9accea, blocks: 0x1 00010000:00010000:2.0:1788529898.994389:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788529898.994394:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529898.994404:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529898.994438:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529898.994453:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100800, rc 0) 00000100:00100000:2.0:1788529898.994548:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+11:2354:x1875409158371840:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 321us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529898.994556:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1788529898.998244:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529898.998388:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372096 00000100:00100000:1.0:1788529898.998430:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372096 00000100:00100000:1.0:1788529898.998514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:1.0:1788529898.998528:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+66:11643:x1875409158372096:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788529898.999013:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+66:11643:x1875409158372096:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 486us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529898.999023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:2.0:1788529899.006007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529899.006192:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372224 00000100:00100000:0.0:1788529899.006207:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372224 00000100:00100000:0.0:1788529899.006307:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1788529899.006321:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+11:11643:x1875409158372224:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788529899.006536:0:12087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529899.006563:0:12087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1121 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.006608:0:12087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.006619:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529899.006624:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529899.006631:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 12 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.006680:0:12087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788529899.006817:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788529899.006855:0:12087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 12 pid: 6687 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529899.006876:0:12087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12087:1875409185627136:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788529899.007285:0:12087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabdd6a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529899.018009:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.018127:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372352 00000100:00100000:1.0:1788529899.018142:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372352 00010000:00010000:1.0:1788529899.018205:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 13 pid: 6687 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.018266:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1788529899.018278:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3eff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:2355:x1875409158372352:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529899.018297:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529899.018328:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 13 pid: 6687 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.018362:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 13 pid: 6687 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.018395:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529899.018400:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529899.018412:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 13 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.018425:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 13 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.018506:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 13 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.018525:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5816:1875409185627264:192.168.201.52@tcp:105: 00000100:00100000:1.0:1788529899.018637:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd113cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788529899.019227:0:12087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067ad20dd/0xaa46022e3f18bf05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da111a expref: 13 pid: 6687 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.019264:0:12087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12087:1875409185627136:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529899.019298:0:12087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 12 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.019313:0:12087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242800, rc 0) 00000100:00100000:3.0:1788529899.019382:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14b4f045-1109-44f4-a991-3ed448c68aea+12:11643:x1875409158372224:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 13064us (13389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.019390:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1788529899.027382:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5816:1875409185627264:192.168.201.52@tcp:105: 00010000:00010000:1.0:1788529899.027423:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529899.027530:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3eff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+11:2355:x1875409158372352:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 9253us (9537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529899.027544:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:2.0:1788529899.030824:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.031245:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372480 00000100:00100000:3.0:1788529899.031260:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372480 00002000:00100000:3.0:1788529899.031343:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cabfcb18a80 x1875409158372480/t0(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:595/0 lens 504/0 e 0 to 0 dl 1788529910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529899.031356:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfcb18a80 with x1875409158372480 ext(0->12) 00002000:00010000:3.0:1788529899.031363:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfcb18a80 00000100:00100000:3.0:1788529899.031403:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788529899.031415:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+11:2355:x1875409158372480:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788529899.032069:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:2355:x1875409158372480:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 654us (1258us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788529899.032079:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00002000:00100000:3.0:1788529899.032087:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cabfcb18a80 x1875409158372480/t4294967320(0) o4->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:595/0 lens 504/448 e 0 to 0 dl 1788529910 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788529899.032338:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabfcb18a80 with x1875409158372480 ext(0->12) 00002000:00010000:3.0:1788529899.032350:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabfcb18a80 00000100:00100000:0.0:1788529899.041723:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.041875:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372608 00000100:00100000:3.0:1788529899.041889:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372608 00000100:00100000:3.0:1788529899.042023:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:3.0:1788529899.042037:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+66:11643:x1875409158372608:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788529899.043803:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529899.114350:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+66:11643:x1875409158372608:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 72293us (72630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.114367:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 227 00000001:00080000:2.0:1788529899.115991:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00000020:00080000:2.0:1788529899.116027:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788529899.116046:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788529899.116080:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788529899.116118:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabc3f6ba80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788529899.116124:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabdd6cea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc3f6b6c0 00000020:00080000:2.0:1788529899.116127:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabdd6ceb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8caac77c6c00 00000004:00080000:2.0:1788529899.116139:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788529899.116157:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8caac5d54d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788529899.116185:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc2bb4500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8caac5d54240 00000020:00080000:2.0:1788529899.116188:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc2bb4c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabf564f800 00000004:00080000:2.0:1788529899.116211:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1788529899.116405:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529899.116427:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185627392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788529899.116519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529899.116860:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185627392 00000100:00100000:3.0:1788529899.116868:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185627392 00000100:00100000:3.0:1788529899.116965:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788529899.116976:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185627392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788529899.117006:0:12086:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788529899.117047:0:12086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9acce9, atime: 0x6a9acce9, ctime: 0x6a9acce9, blocks: 0xb 00010000:00010000:3.0:1788529899.117056:0:12086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.117076:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1788529899.117081:0:12086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788529899.117099:0:12086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.117119:0:12086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.117130:0:12086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.117148:0:12086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.117168:0:12086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788529899.117976:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3300:x1875409185627392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 999us (1453us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788529899.117986:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788529899.118024:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185627648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788529899.118076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788529899.118224:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788529899.118388:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788529899.118838:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185627520:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788529899.118990:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529899.119423:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185627648 00000100:00100000:0.0:1788529899.119434:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185627648 00000100:00100000:0.0:1788529899.119520:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788529899.119530:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185627648:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788529899.119824:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788529899.119922:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788529899.119926:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788529899 00002000:00010000:0.0:1788529899.119930:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788529899.119932:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788529898 -> 1788529899 00002000:00010000:0.0:1788529899.119935:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788529899.119995:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875409185627648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 467us (1919us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788529899.120004:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788529899.122228:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529899.122246:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.122263:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529899.122270:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.122283:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.122313:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.122323:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000688678f1/0xaa46022e3f18bf13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.122365:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529899.122386:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529899.122388:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788529899.135014:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabfcb1bb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788529899.135037:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185627392:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788529899.145394:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabf6083800/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788529899.145417:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185627648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788529899.145570:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529899.145620:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185627520 00000100:00100000:3.0:1788529899.145630:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185627520 00000100:00100000:3.0:1788529899.145684:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788529899.145696:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1875409185627520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788529899.145753:0:12087:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788529899.145794:0:12087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.145825:0:12087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 12 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.145836:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788529899.145842:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788529899.145858:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.145922:0:12087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 12 pid: 12086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.145944:0:12087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 12 pid: 12086 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.145963:0:12087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12087:1875409185627776:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529899.146054:0:12087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529899.146886:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529899.148514:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372736 00000100:00100000:0.0:1788529899.148531:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372736 00000100:00100000:0.0:1788529899.148604:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1788529899.148617:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+13:2354:x1875409158372736:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788529899.150515:0:12087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12087:1875409185627776:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529899.150558:0:12087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.155210:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.155954:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158372864 00000100:00100000:3.0:1788529899.155969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158372864 00010000:00010000:3.0:1788529899.156027:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 14 pid: 12086 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.156082:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1788529899.156103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+14:2354:x1875409158372864:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529899.156122:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529899.156129:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 14 pid: 12086 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.156153:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 14 pid: 12086 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.156207:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221f1e50/0xaa46022e3f18bcd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1080 expref: 14 pid: 12086 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.156230:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788529899.156236:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788529899.156243:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.156255:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.156295:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529899.156667:0:12087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.156679:0:12087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.156690:0:12087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.156700:0:12087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.156733:0:12087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788529899.157522:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3302:x1875409185627520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11824us (11949us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788529899.157534:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1788529899.157607:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabf6082680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788529899.157614:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185627520:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788529899.157793:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529899.157804:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.157827:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529899.157833:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.157843:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.157860:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.157867:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fd036/0xaa46022e3f18bf1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.157933:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529899.157935:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529899.157937:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529899.159346:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+13:2354:x1875409158372864:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 3242us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.159361:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000001:00080000:1.0:1788529899.175032:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788529899.175056:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1788529899.216495:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788529899.216517:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788529899.216530:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788529899.217094:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158372736:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 68464us (70198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.217109:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:2.0:1788529899.224797:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.225019:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373120 00000100:00100000:3.0:1788529899.225033:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373120 00000100:00100000:3.0:1788529899.225134:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 228 00000100:00100000:3.0:1788529899.225146:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:11643:x1875409158373120:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788529899.225224:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529899.225263:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc243400/0xaa46022e3f18befe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1113 expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.225336:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529899.225343:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788529899.225389:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.225407:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.225419:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788529899.227990:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e13adca1 reply state 00000000be9c2103 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.228015:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788529899.228191:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:11643:x1875409158373120:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 3040us (3400us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788529899.228200:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 228 00010000:00010000:3.0:1788529899.232955:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.232963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1788529899.232973:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.232982:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.232989:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529899.232997:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.233027:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.233050:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529899.233054:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529899.233060:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.233079:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529899.233138:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373248 00000100:00100000:0.0:1788529899.233153:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373248 00000100:00100000:0.0:1788529899.233227:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1788529899.233243:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158373248:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788529899.233790:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788529899.233795:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788529899 -> 1788529898 00002000:00010000:0.0:1788529899.233797:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788529897 00002000:00010000:0.0:1788529899.233800:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788529899 -> 1788529898 00002000:00010000:0.0:1788529899.233802:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788529899.233987:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+8:2355:x1875409158373248:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 747us (1033us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788529899.233996:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1788529899.238784:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529899.241036:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373504 00000100:00100000:2.0:1788529899.241057:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373504 00000100:00100000:2.0:1788529899.241184:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:2.0:1788529899.241196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+20:11643:x1875409158373504:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788529899.241294:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.241317:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.241328:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.241385:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.241408:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 20 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.241426:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185627904:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529899.241582:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441600 going to sleep for 11 seconds 00000100:00100000:2.0:1788529899.245060:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.245492:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875409185627904:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788529899.245538:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.245547:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373632 00000100:00100000:3.0:1788529899.245556:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373632 00010000:00010000:3.0:1788529899.245606:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.245655:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:3.0:1788529899.245667:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+21:2355:x1875409158373632:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529899.245685:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529899.245694:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245724:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245752:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7c00/0xaa46022e3f18bee2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1105 expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245795:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:3.0:1788529899.245800:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245810:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245820:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.245851:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788529899.245925:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.245933:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.245940:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4f045-1109-44f4-a991-3ed448c68aea+20:2355:x1875409158373632:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 275us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.245950:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00010000:00010000:1.0:1788529899.245982:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.245990:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.245997:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.246003:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529899.246008:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.246018:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.246029:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:1.0:1788529899.246032:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788529899.246037:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.246043:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18bf28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.246092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:11643:x1875409158373504:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 4897us (7399us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788529899.246101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:0.0:1788529899.258160:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529899.258355:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373760 00000100:00100000:2.0:1788529899.258370:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373760 00000100:00100000:2.0:1788529899.258445:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:2.0:1788529899.258457:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2356:x1875409158373760:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788529899.258532:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.258557:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 8 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.258585:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788529899.258591:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788529899.258596:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.258645:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 8 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.258668:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 8 pid: 12087 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.258687:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1875409185628032:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788529899.258816:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441600 going to sleep for 11 seconds 00000100:00100000:0.0:1788529899.263983:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.264371:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158373888 00000100:00100000:1.0:1788529899.264384:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158373888 00010000:00010000:1.0:1788529899.264442:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 9 pid: 12087 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.264531:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:1.0:1788529899.264544:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+9:2354:x1875409158373888:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788529899.264572:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788529899.264685:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1875409185628032:192.168.201.52@tcp:104: 00010000:00010000:2.0:1788529899.264731:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264789:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 9 pid: 12087 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264811:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 9 pid: 12087 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264840:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4d75f58/0xaa46022e3f18bf0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1121 expref: 9 pid: 12087 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264859:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529899.264865:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788529899.264872:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264882:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.264963:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788529899.265025:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.265035:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2354:x1875409158373888:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 494us (1071us total) trans 0 rc 0/0 00010000:00010000:0.0:1788529899.265036:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.265044:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00010000:00010000:0.0:1788529899.265078:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265089:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265681:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265691:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529899.265696:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265810:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265842:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.265850:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb22c34f/0xaa46022e3f18bf2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529899.265957:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158373760:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 7501us (7812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529899.265968:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1788529899.271614:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.272020:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158374144 00000100:00100000:3.0:1788529899.272035:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158374144 00000100:00100000:3.0:1788529899.272523:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 230 00000100:00100000:3.0:1788529899.272539:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:11643:x1875409158374144:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788529899.272660:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.272683:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.272698:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.273119:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.273153:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.273165:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.273227:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.273254:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 20 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.273275:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185628160:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529899.273418:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529899.278008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529899.278385:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185628160:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788529899.278423:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.278537:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158374272 00000100:00100000:2.0:1788529899.278558:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158374272 00010000:00010000:2.0:1788529899.278614:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.278659:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:2.0:1788529899.278670:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+21:2354:x1875409158374272:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529899.278709:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529899.278718:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278738:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278766:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031400/0xaa46022e3f18bef0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da110c expref: 21 pid: 7603 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278789:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:2.0:1788529899.278795:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278807:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278816:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529899.278850:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529899.278956:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4f045-1109-44f4-a991-3ed448c68aea+20:2354:x1875409158374272:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 287us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529899.278964:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00010000:00010000:0.0:1788529899.279426:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.279436:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788529899.279719:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788529899.279944:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788529899.279999:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788529899.280987:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185628288:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788529899.281125:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529899.281182:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd2074b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529899.282572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185628288 00000100:00100000:2.0:1788529899.282587:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185628288 00000100:00100000:2.0:1788529899.282669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788529899.282681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875409185628288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788529899.282832:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875409185628288:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529899.282853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788529899.283254:0:5829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788529899.283262:0:5829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788529899.283289:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabf6083800, transno 4294967321 00000100:00100000:0.0:1788529899.283314:0:5829:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cabf6082680 x1875409185627520/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788529915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529899.283330:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185628288:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788529899.284609:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788529899.285398:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185628416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788529899.285490:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529899.285532:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529899.285645:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185628416 00000100:00100000:2.0:1788529899.285656:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185628416 00000100:00100000:2.0:1788529899.285734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788529899.285745:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875409185628416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788529899.286058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5829:x1875409185628416:12345-0@lo:1000:mdt00_000.0 Request processed in 313us (566us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788529899.287030:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788529899.288002:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875409185628416:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788529899.288079:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289210:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289221:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289229:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529899.289235:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289245:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289267:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc9230d00) 00010000:00010000:0.0:1788529899.289271:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529899.289302:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289310:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36c00/0xaa46022e3f18bf3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289361:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289368:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289373:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289378:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788529899.289381:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289387:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289395:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:0.0:1788529899.289397:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788529899.289407:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289420:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289431:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.289511:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529899.289533:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfbc81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185628544:192.168.201.52@tcp:105: 00000100:00100000:0.0:1788529899.289674:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd20f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529899.295670:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfbc81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875409185628544:192.168.201.52@tcp:105: 00010000:00010000:3.0:1788529899.295731:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295745:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48400/0xaa46022e3f18be80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295789:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295806:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295819:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295848:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295855:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295862:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295868:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529899.295872:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295881:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295913:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529899.295917:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529899.295922:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295928:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295939:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295945:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295951:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295962:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529899.295965:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295971:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295979:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529899.295981:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788529899.295984:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.295990:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529899.297017:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.297208:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+23:11643:x1875409158374144:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 24671us (25606us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788529899.297223:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 230 00000020:00080000:3.0:1788529899.297230:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788529899.297455:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158374400 00000100:00100000:1.0:1788529899.297466:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158374400 00000100:00100000:1.0:1788529899.297544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1788529899.297564:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+23:11642:x1875409158374400:12345-192.168.201.52@tcp:49:lfs.0 00000100:00100000:1.0:1788529899.297688:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+23:11642:x1875409158374400:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 127us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529899.297695:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1788529899.301732:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529899.301836:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529899.301881:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158374912 00000100:00100000:0.0:1788529899.301915:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158374912 00000100:00100000:0.0:1788529899.301985:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:0.0:1788529899.301997:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:11642:x1875409158374912:12345-192.168.201.52@tcp:58:lfs.0 00000040:00080000:0.0:1788529899.302867:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788529899.303039:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+23:11642:x1875409158374912:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 1040us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529899.303049:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:1.0:1788529899.303770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158374656 00000100:00100000:1.0:1788529899.303781:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158374656 00000100:00100000:1.0:1788529899.303843:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:1.0:1788529899.303854:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+24:11643:x1875409158374656:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788529899.305503:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788529899.305650:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788529899.305740:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305763:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305778:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305789:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305796:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305804:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.305850:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788529899.306025:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+25:11643:x1875409158374656:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 2167us (4320us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788529899.306036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000020:00080000:1.0:1788529899.306043:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788529899.306512:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529899.306523:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.306532:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529899.306538:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.306548:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.306579:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cabc3837b00) 00010000:00010000:0.0:1788529899.306582:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788529899.306589:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.306596:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18bf4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529899.306621:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529899.306623:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529899.306624:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529899.307155:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529899.307160:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529899.307205:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788529899.307211:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529899.307361:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185628672:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788529899.307451:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788529899.314938:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc8c1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875409185628672:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788529899.320526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.320844:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158375040 00000100:00100000:1.0:1788529899.320859:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158375040 00000100:00100000:1.0:1788529899.320988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:1.0:1788529899.321002:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+25:11644:x1875409158375040:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788529899.321057:0:5830:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788529899.321210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+25:11644:x1875409158375040:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 210us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529899.321219:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:0.0:1788529899.327302:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.327439:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158375296 00000100:00100000:1.0:1788529899.327455:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158375296 00000100:00100000:1.0:1788529899.327543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:1.0:1788529899.327557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+25:11644:x1875409158375296:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788529899.327586:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529899.327615:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1128 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.327768:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bf59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.327789:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bf59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.327832:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bf59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788529899.327848:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788529899.328323:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1128 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.328350:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bf59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1128 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.328360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529899.328363:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788529899.328368:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529899.328513:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfbc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+27:11644:x1875409158375296:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 958us (1226us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788529899.328521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:0.0:1788529899.352963:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529899.353072:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158375552 00000100:00100000:1.0:1788529899.353086:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158375552 00000100:00100000:1.0:1788529899.353174:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:1.0:1788529899.353188:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+27:11644:x1875409158375552:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788529899.353303:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353328:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353343:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353645:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353655:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353662:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353669:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788529899.353674:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353684:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353699:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:1.0:1788529899.353703:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788529899.353721:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529899.353727:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18bf67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529899.353984:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14b4f045-1109-44f4-a991-3ed448c68aea+28:11644:x1875409158375552:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 798us (1034us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788529899.353994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 234 00000040:00080000:2.0:1788529899.354445:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529899.354451:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529899.354986:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788529899.354995:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788529899.363085:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.363247:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158375680 00000100:00100000:3.0:1788529899.363261:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158375680 00000100:00100000:3.0:1788529899.363340:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1788529899.363353:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+28:11646:x1875409158375680:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529899.363383:0:7603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529899.363412:0:7603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da112f expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363545:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363564:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363578:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363594:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363601:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363607:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.363989:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.364003:0:7603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.364014:0:7603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.364062:0:7603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.364331:0:7603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 29 pid: 5829 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.364352:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185628800:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788529899.364488:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54840 going to sleep for 11 seconds 00000100:00100000:0.0:1788529899.369020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.369187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158375936 00000100:00100000:3.0:1788529899.369201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158375936 00000100:00100000:3.0:1788529899.369284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:3.0:1788529899.369296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+30:11644:x1875409158375936:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788529899.369639:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+31:11644:x1875409158375936:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 344us (632us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788529899.369648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1788529899.372501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.373256:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7603:1875409185628800:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788529899.373294:0:7603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529899.373493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376192 00000100:00100000:2.0:1788529899.373503:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376192 00000100:00100000:2.0:1788529899.373633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1788529899.373646:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+31:5597:x1875409158376192:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788529899.374044:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+32:5597:x1875409158376192:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 398us (1556us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788529899.374578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1788529899.381664:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529899.382125:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376320 00000100:00100000:3.0:1788529899.382140:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376320 00010000:00010000:3.0:1788529899.382203:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 32 pid: 5829 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529899.382264:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1788529899.382275:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+32:2355:x1875409158376320:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788529899.382296:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788529899.382322:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 32 pid: 5829 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382343:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 32 pid: 5829 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382372:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49400/0xaa46022e3f18be72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10e9 expref: 32 pid: 5829 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382392:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529899.382399:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382412:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382422:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382462:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529899.382555:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4f045-1109-44f4-a991-3ed448c68aea+31:2355:x1875409158376320:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 280us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.382563:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00010000:00010000:3.0:1788529899.382600:0:7603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382610:0:7603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529899.382669:0:7603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788529899.382674:0:7603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788529899.382725:0:7603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382742:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382754:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382761:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382768:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382775:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529899.382780:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382788:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382798:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:3.0:1788529899.382801:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529899.382805:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382811:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382823:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382829:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382844:0:7603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382849:0:7603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529899.382852:0:7603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382858:0:7603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382867:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cabc9230500) 00010000:00010000:3.0:1788529899.382870:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788529899.382873:0:7603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382879:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382976:0:7603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da112f expref: 31 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.382995:0:7603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da112f expref: 30 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529899.383002:0:7603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529899.383004:0:7603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788529899.383007:0:7603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabeff36a00, rc 0) 00000100:00100000:3.0:1788529899.383040:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+30:11646:x1875409158375680:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 19689us (19980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529899.383057:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 235 00010000:00010000:2.0:1788529899.853178:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529900.110951:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185629056:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111123:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185629568:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111191:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788529900.111198:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185628928:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111251:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185629440:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111302:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629312:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111339:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111362:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529900.111367:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185629184:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.111391:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.111425:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629056 00000100:00100000:0.0:1788529900.111435:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629056 00000100:00100000:0.0:1788529900.111502:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629440 00000100:00100000:0.0:1788529900.111506:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629440 00000100:00100000:0.0:1788529900.111529:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629184 00000100:00100000:0.0:1788529900.111531:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629184 00000100:00100000:0.0:1788529900.112530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788529900.112547:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185629056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529900.112573:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788529900.112585:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185629440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529900.112674:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185629440:12345-0@lo:400:kworker.0 Request processed in 92us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529900.112683:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788529900.112712:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788529900.112719:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185629184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529900.112755:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185629184:12345-0@lo:400:kworker.0 Request processed in 37us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529900.112761:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788529900.113952:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875409185629056:12345-0@lo:400:kworker.0 Request processed in 1404us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.113965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788529900.114014:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185628928 00000100:00100000:0.0:1788529900.114024:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185628928 00000100:00100000:0.0:1788529900.114084:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788529900.114092:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185628928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.114145:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185628928:12345-0@lo:400:kworker.0 Request processed in 54us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.114150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788529900.114185:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629568 00000100:00100000:0.0:1788529900.114190:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629568 00000100:00100000:0.0:1788529900.114220:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629312 00000100:00100000:0.0:1788529900.114223:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629312 00000100:00100000:0.0:1788529900.114241:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788529900.114247:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185629568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.114299:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185629568:12345-0@lo:400:kworker.0 Request processed in 53us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.114305:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788529900.114315:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788529900.114320:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185629312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.114343:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185629312:12345-0@lo:400:kworker.0 Request processed in 23us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.114348:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788529900.114452:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185629184:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.114485:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788529900.114491:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabf569c380, transno 4294967307 00000004:00080000:0.0:1788529900.114503:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788529900.114530:0:3303:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cabfcb1bb80 x1875409185627392/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788529915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529900.114542:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629312:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.116768:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529900.116800:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788529900.116919:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529900.117016:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629696 00000100:00100000:0.0:1788529900.117026:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629696 00000100:00100000:0.0:1788529900.117088:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788529900.117100:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875409185629696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529900.117131:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788529900.117184:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875409185629696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.117213:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788529900.117266:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185628928:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.117286:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185629440:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.117321:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875409185629056:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.117336:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185629568:0@lo:400:kworker.0 00000100:00100000:0.0:1788529900.117397:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788529900.117690:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788529900.377640:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529900.377654:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529900.377702:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788529900.377710:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788529900.590104:0:12537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788529900.590117:0:12537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788529900.590558:0:12537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788529900.590577:0:12537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788529900.833426:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529900.833520:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529900.833547:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529900.833579:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376576 00000100:00100000:1.0:1788529900.833593:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376576 00000100:00100000:1.0:1788529900.833660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:1.0:1788529900.833673:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+30:2355:x1875409158376576:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529900.833770:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+30:2355:x1875409158376576:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529900.833779:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:1.0:1788529900.833819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529900.833932:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529900.834242:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376704 00000100:00100000:0.0:1788529900.834247:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376704 00000100:00100000:0.0:1788529900.834303:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376832 00000100:00100000:0.0:1788529900.834307:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376832 00000100:00100000:0.0:1788529900.834330:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1788529900.834339:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158376704:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529900.834382:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2355:x1875409158376704:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.834389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1788529900.834404:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:0.0:1788529900.834410:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158376832:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529900.834437:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2355:x1875409158376832:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.834454:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:0.0:1788529900.834474:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376960 00000100:00100000:0.0:1788529900.834477:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376960 00000100:00100000:0.0:1788529900.834505:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:0.0:1788529900.834526:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158376960:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529900.834556:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38bca45c-488d-404b-89e3-533f2a694da6+5:2355:x1875409158376960:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 31us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529900.834563:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00080000:1.0:1788529900.840949:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788529900.840966:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529900.847177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158376448 00000100:00100000:2.0:1788529900.847199:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158376448 00000100:00100000:2.0:1788529900.847266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 337 00000100:00100000:2.0:1788529900.847278:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158376448:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529900.847388:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2355:x1875409158376448:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 111us (13976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529900.847397:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 337 00010000:00010000:1.0:1788529900.881004:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529900.941326:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529900.941510:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377216 00000100:00100000:3.0:1788529900.941523:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377216 00000100:00100000:3.0:1788529900.941594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:3.0:1788529900.941753:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+30:11669:x1875409158377216:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788529900.941781:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529900.941808:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1136 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.941965:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.941985:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.941998:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788529900.942023:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788529900.942176:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36800/0xaa46022e3f18bf8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1136 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.942198:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1136 expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.942208:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529900.942211:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788529900.942217:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabeff37400, rc 0) 00000100:00100000:3.0:1788529900.942285:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+32:11669:x1875409158377216:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 680us (973us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788529900.942293:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:1.0:1788529900.961821:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529900.962518:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377344 00000100:00100000:3.0:1788529900.962534:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377344 00000100:00100000:3.0:1788529900.986509:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:3.0:1788529900.986545:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+32:11669:x1875409158377344:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1788529900.986647:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986670:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986685:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986722:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986749:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986757:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986765:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788529900.986770:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986779:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986793:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:3.0:1788529900.986797:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788529900.986803:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529900.986810:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36200/0xaa46022e3f18bf9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529900.986937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+32:11669:x1875409158377344:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 410us (25129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529900.986945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:3.0:1788529901.127307:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529901.127422:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377472 00000100:00100000:2.0:1788529901.127468:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377472 00000100:00100000:2.0:1788529901.127582:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:2.0:1788529901.127599:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+7:2357:x1875409158377472:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:2.0:1788529901.127628:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529901.127662:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0abb55f/0xaa46022e3f18bfa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da113d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788529901.127702:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9accea, atime: 0x6a9acce9, ctime: 0x6a9accea, blocks: 0xb 00010000:00010000:2.0:1788529901.127731:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788529901.127737:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788529901.127750:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0abb55f/0xaa46022e3f18bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da113d expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529901.127797:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0abb55f/0xaa46022e3f18bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da113d expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529901.127815:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100600, rc 0) 00000100:00080000:1.0:1788529901.128076:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788529901.128220:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14b4f045-1109-44f4-a991-3ed448c68aea+8:2357:x1875409158377472:12345-192.168.201.52@tcp:101:cat.0 Request processed in 625us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529901.128228:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:3.0:1788529901.139662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529901.139856:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377600 00000100:00100000:1.0:1788529901.139871:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377600 00002000:00100000:1.0:1788529901.139995:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cabc75eed80 x1875409158377600/t0(0) o3->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:597/0 lens 488/0 e 0 to 0 dl 1788529912 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788529901.140008:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc75eed80 with x1875409158377600 ext(0->4095) 00002000:00010000:1.0:1788529901.140015:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabc75eed80 00000100:00100000:1.0:1788529901.140052:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1788529901.140074:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2357:x1875409158377600:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:1.0:1788529901.140369:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14b4f045-1109-44f4-a991-3ed448c68aea+8:2357:x1875409158377600:12345-192.168.201.52@tcp:3:cat.0 Request processed in 306us (722us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788529901.140396:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00002000:00100000:1.0:1788529901.140405:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cabc75eed80 x1875409158377600/t0(0) o3->14b4f045-1109-44f4-a991-3ed448c68aea@192.168.201.52@tcp:597/0 lens 488/4536 e 0 to 0 dl 1788529912 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788529901.140414:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cabc75eed80 with x1875409158377600 ext(0->4095) 00002000:00010000:1.0:1788529901.140418:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cabc75eed80 00010000:00010000:0.0:1788529901.902961:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529902.168361:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788529902.168440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529902.168557:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629824 00000100:00100000:1.0:1788529902.168567:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629824 00000100:00100000:1.0:1788529902.168634:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788529902.168645:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185629824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529902.168692:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529902.168745:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185629824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529902.168753:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788529902.168931:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788529902.168965:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185629824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788529902.936029:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529903.950462:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788529904.331495:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:3.0:1788529904.331506:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cabc5bb9f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788529904.331511:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc3402c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc5bb9b40 00000020:00080000:3.0:1788529904.331523:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cabc3402600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cabc75e4400 00000001:00080000:3.0:1788529904.332658:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:3.0:1788529904.332672:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788529904.332681:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1788529904.332689:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788529904.332721:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788529904.334229:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788529904.334831:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788529904.357853:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788529904.357879:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1788529904.974524:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529905.229347:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185630208:0@lo:400:kworker.0 00000100:00100000:2.0:1788529905.229408:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185629952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529905.229432:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185630080:0@lo:400:kworker.0 00000100:00100000:2.0:1788529905.236490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529905.236609:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788529905.236669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529905.236743:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630464 00000100:00100000:2.0:1788529905.236754:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630464 00000100:00100000:2.0:1788529905.236829:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788529905.236841:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185630464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.237028:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185629952 00000100:00100000:0.0:1788529905.237034:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185629952 00000100:00100000:0.0:1788529905.237072:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788529905.237079:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185629952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529905.237118:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529905.237167:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185629952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.237175:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788529905.237224:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788529905.237231:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabf6082680, transno 4294967322 00000004:00080000:0.0:1788529905.237252:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788529905.237291:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185629952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529905.237479:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185630464:12345-0@lo:400:kworker.0 Request processed in 640us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529905.237487:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788529905.237511:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788529905.237516:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788529905.237553:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185630336:0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.237635:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788529905.237640:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabfcb1bb80, transno 4294967310 00000100:00100000:0.0:1788529905.237653:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788529905.238274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529905.238469:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630336 00000100:00100000:0.0:1788529905.238476:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630336 00000100:00100000:0.0:1788529905.238525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788529905.238534:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185630336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.238604:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185630336:12345-0@lo:400:kworker.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.238612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1788529905.238630:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788529905.238837:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185630336:0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.240219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529905.240289:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185630592:0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.240331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529905.240402:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630080 00000100:00100000:2.0:1788529905.240411:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630080 00000100:00100000:1.0:1788529905.240441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630592 00000100:00100000:1.0:1788529905.240448:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630592 00000100:00100000:2.0:1788529905.240477:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788529905.240490:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529905.240498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788529905.240509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529905.240564:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185630592:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529905.240572:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185630080:12345-0@lo:400:kworker.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529905.240573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788529905.240585:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:1.0:1788529905.240617:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529905.242446:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185630080:0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.242470:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185630592:0@lo:400:kworker.0 00000100:00100000:3.0:1788529905.243753:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529905.243821:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185630720:0@lo:400:kworker.0 00000100:00100000:3.0:1788529905.243887:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529905.244040:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630208 00000100:00100000:0.0:1788529905.244051:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630208 00000100:00100000:0.0:1788529905.244112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788529905.244123:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185630208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529905.244206:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185630208:12345-0@lo:400:kworker.0 Request processed in 85us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.244214:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788529905.244243:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185630208:0@lo:400:kworker.0 00000100:00100000:1.0:1788529905.245751:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630720 00000100:00100000:1.0:1788529905.245765:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630720 00000100:00100000:1.0:1788529905.245860:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788529905.245870:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185630720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529905.245993:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185630720:12345-0@lo:400:kworker.0 Request processed in 115us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529905.246001:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788529905.246720:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185630720:0@lo:400:kworker.0 00000100:00100000:3.0:1788529905.955848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788529905.955884:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529905.956007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377728 00000100:00100000:0.0:1788529905.956017:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377728 00000100:00100000:0.0:1788529905.956076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 339 00000100:00100000:0.0:1788529905.956087:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158377728:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529905.956339:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158377728:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 253us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.956368:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 339 00000100:00100000:2.0:1788529905.956497:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377856 00000100:00100000:2.0:1788529905.956502:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377856 00000100:00100000:2.0:1788529905.956543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:2.0:1788529905.956551:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:2357:x1875409158377856:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529905.956585:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:2357:x1875409158377856:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529905.956592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00080000:0.0:1788529905.956654:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529905.961619:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529905.961661:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529905.961688:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529905.961715:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378112 00000100:00100000:0.0:1788529905.961724:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378112 00000100:00100000:0.0:1788529905.961779:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158377984 00000100:00100000:0.0:1788529905.961782:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158377984 00000100:00100000:0.0:1788529905.961805:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:0.0:1788529905.961813:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158378112:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529905.961879:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2356:x1875409158378112:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.961886:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:0.0:1788529905.961930:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1788529905.961936:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158377984:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529905.961958:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2356:x1875409158377984:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.961964:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1788529905.961994:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378240 00000100:00100000:0.0:1788529905.961998:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378240 00000100:00100000:0.0:1788529905.962023:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1788529905.962029:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158378240:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788529905.962056:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:2356:x1875409158378240:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529905.962077:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00080000:0.0:1788529905.962100:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788529905.962118:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788529905.962120:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788529906.000480:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529907.021941:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529907.155521:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529907.155692:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378368 00000100:00100000:1.0:1788529907.155716:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378368 00000100:00100000:1.0:1788529907.155802:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:1.0:1788529907.155815:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:11330:x1875409158378368:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788529907.156000:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14b4f045-1109-44f4-a991-3ed448c68aea+19:11330:x1875409158378368:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 187us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529907.156009:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00080000:0.0:1788529907.157007:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529907.159201:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529907.159452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378624 00000100:00100000:2.0:1788529907.159465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378624 00000100:00100000:2.0:1788529907.159542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1788529907.159553:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+19:11330:x1875409158378624:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788529907.160277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14b4f045-1109-44f4-a991-3ed448c68aea+20:11330:x1875409158378624:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 721us (1086us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788529907.160288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:3.0:1788529907.277387:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185630848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529907.277485:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529907.277679:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630848 00000100:00100000:1.0:1788529907.277689:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630848 00000100:00100000:1.0:1788529907.277772:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788529907.277785:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185630848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529907.277828:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788529907.277972:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529907.278065:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185630848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529907.278072:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788529907.278144:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185630848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529907.599975:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529907.600218:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378752 00000100:00100000:0.0:1788529907.600232:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378752 00000100:00100000:0.0:1788529907.600347:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:0.0:1788529907.600359:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+5:12120:x1875409158378752:12345-192.168.201.52@tcp:101:lsof.0 00010000:00010000:0.0:1788529907.600388:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529907.600416:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18bfad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1144 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600503:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600521:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600539:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788529907.600587:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788529907.600591:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788529907.600621:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600653:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242a00/0xaa46022e3f18bfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1144 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600699:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1144 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529907.600708:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:0.0:1788529907.600712:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788529907.600716:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242400, rc 0) 00000100:00100000:0.0:1788529907.600812:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:12120:x1875409158378752:12345-192.168.201.52@tcp:101:lsof.0 Request processed in 455us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529907.600819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00080000:3.0:1788529907.601480:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788529908.045153:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529909.069796:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788529909.385187:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788529909.385210:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788529909.385281:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788529909.385365:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788529910.093255:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529910.349384:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788529910.359116:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185631488:0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.359234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529910.359342:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788529910.359351:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185631104:0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.359389:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529910.359421:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185631616:0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.359452:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529910.359492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631104 00000100:00100000:2.0:1788529910.359502:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631104 00000100:00100000:2.0:1788529910.359559:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788529910.359571:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185631104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.359633:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185631104:12345-0@lo:400:kworker.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529910.359642:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788529910.359700:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185631104:0@lo:400:kworker.0 00000100:00100000:0.0:1788529910.360088:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631488 00000100:00100000:0.0:1788529910.360094:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631488 00000100:00100000:0.0:1788529910.360161:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788529910.360168:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185631488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529910.360227:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185631488:12345-0@lo:400:kworker.0 Request processed in 59us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529910.360234:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788529910.360268:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185631232:0@lo:400:kworker.0 00000100:00100000:0.0:1788529910.360288:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185631360:0@lo:400:kworker.0 00000100:00100000:0.0:1788529910.360318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529910.360336:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631616 00000100:00100000:3.0:1788529910.360339:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631616 00000100:00100000:3.0:1788529910.360371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631360 00000100:00100000:3.0:1788529910.360374:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631360 00000100:00100000:3.0:1788529910.360408:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788529910.360416:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185631616:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788529910.360431:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788529910.360437:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529910.360450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185631616:12345-0@lo:400:kworker.0 Request processed in 36us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529910.360450:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788529910.360456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788529910.360457:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185631360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360479:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529910.360493:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185631360:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529910.360498:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185631744:0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.360499:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788529910.360510:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631232 00000100:00100000:2.0:1788529910.360513:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631232 00000100:00100000:2.0:1788529910.360533:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788529910.360537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529910.360538:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529910.360564:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185631232:12345-0@lo:400:kworker.0 Request processed in 26us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529910.360566:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631744 00000100:00100000:3.0:1788529910.360569:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631744 00000100:00100000:2.0:1788529910.360576:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788529910.360599:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788529910.360605:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185631744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360634:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185631744:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529910.360640:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788529910.360657:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788529910.360679:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185631232:0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360688:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185631744:0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360722:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185631360:0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360742:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185631616:0@lo:400:kworker.0 00000100:00100000:3.0:1788529910.360751:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185631488:0@lo:400:kworker.0 00000100:00100000:1.0:1788529910.365260:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185630976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529910.366384:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529910.366532:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185630976 00000100:00100000:3.0:1788529910.366545:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185630976 00000100:00100000:3.0:1788529910.366671:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788529910.366685:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185630976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788529910.366753:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788529910.370371:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185630976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3674us (3977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529910.370391:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788529910.372917:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185630976:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788529910.606358:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788529910.606372:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788529910.607691:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788529910.607703:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788529911.074638:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529911.074677:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529911.074709:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529911.074728:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529911.074746:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529911.074770:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379392 00000100:00100000:2.0:1788529911.074787:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379392 00000100:00100000:2.0:1788529911.074836:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379008 00000100:00100000:2.0:1788529911.074840:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379008 00000100:00100000:2.0:1788529911.074864:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1788529911.074885:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+6:2354:x1875409158379392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529911.074978:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac77cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+6:2354:x1875409158379392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529911.074985:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1788529911.075003:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1788529911.075009:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+19:2354:x1875409158379008:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529911.075036:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14b4f045-1109-44f4-a991-3ed448c68aea+19:2354:x1875409158379008:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529911.075041:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1788529911.075061:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379136 00000100:00100000:2.0:1788529911.075065:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379136 00000100:00100000:2.0:1788529911.075119:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379264 00000100:00100000:2.0:1788529911.075122:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379264 00000100:00100000:2.0:1788529911.075138:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:2.0:1788529911.075144:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158379136:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529911.075169:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2354:x1875409158379136:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529911.075176:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:2.0:1788529911.075187:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:2.0:1788529911.075192:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158379264:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529911.075216:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2354:x1875409158379264:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529911.075222:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:3.0:1788529911.075713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158378880 00000100:00100000:3.0:1788529911.075719:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158378880 00000100:00100000:3.0:1788529911.075760:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 341 00000100:00100000:3.0:1788529911.075767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158378880:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788529911.075805:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2354:x1875409158378880:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 38us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529911.075811:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 341 00000100:00080000:3.0:1788529911.075842:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529911.075847:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529911.075849:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788529911.117078:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788529911.720812:0:12739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:51:50 (1788529910) 00010000:00010000:3.0:1788529912.147815:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529912.398334:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529912.398367:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185631872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788529912.398463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529912.398643:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185631872 00000100:00100000:0.0:1788529912.398655:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185631872 00000100:00100000:0.0:1788529912.398744:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788529912.398778:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185631872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529912.398824:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529912.398885:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185631872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529912.398923:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788529912.399009:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529912.399139:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185631872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788529913.176200:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529914.189200:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529915.213570:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529915.469463:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529915.469497:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788529915.469600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529915.469930:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185632256:0@lo:400:kworker.0 00000100:00100000:2.0:1788529915.469971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529915.469999:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788529915.470005:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185632384:0@lo:400:kworker.0 00000100:00100000:2.0:1788529915.470029:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529915.470062:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632256 00000100:00100000:2.0:1788529915.470071:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632256 00000100:00100000:1.0:1788529915.470370:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185632128:0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529915.470436:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc3273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185632640:0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529915.470477:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529915.470482:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185632512:0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529915.470551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632384 00000100:00100000:1.0:1788529915.470556:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632384 00000100:00100000:1.0:1788529915.470607:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632640 00000100:00100000:1.0:1788529915.470610:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632640 00000100:00100000:1.0:1788529915.470634:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788529915.470644:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185632384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470720:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185632384:12345-0@lo:400:kworker.0 Request processed in 77us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529915.470729:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788529915.470750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788529915.470758:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185632640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470790:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185632640:12345-0@lo:400:kworker.0 Request processed in 34us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529915.470827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788529915.470872:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185632384:0@lo:400:kworker.0 00000100:00100000:1.0:1788529915.470932:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc3273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185632640:0@lo:400:kworker.0 00000100:00100000:2.0:1788529915.471412:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788529915.471423:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185632256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529915.471474:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185632256:12345-0@lo:400:kworker.0 Request processed in 53us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529915.471490:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788529915.471524:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185632256:0@lo:400:kworker.0 00000100:00100000:0.0:1788529915.471619:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632000 00000100:00100000:0.0:1788529915.471625:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632000 00000100:00100000:0.0:1788529915.471673:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788529915.471681:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185632000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788529915.471731:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529915.471780:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529915.471787:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788529915.471818:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632128 00000100:00100000:0.0:1788529915.471822:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632128 00000100:00100000:0.0:1788529915.471847:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788529915.471854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185632128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529915.471890:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3301:x1875409185632128:12345-0@lo:400:kworker.0 Request processed in 36us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529915.471915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788529915.471954:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185632128:0@lo:400:kworker.0 00000100:00100000:0.0:1788529915.471975:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788529915.473147:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632512 00000100:00100000:3.0:1788529915.473159:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632512 00000100:00100000:3.0:1788529915.473253:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788529915.473265:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185632512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529915.473358:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185632512:12345-0@lo:400:kworker.0 Request processed in 95us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529915.473384:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788529915.473410:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529915.473414:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529915.473417:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788529915.473844:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185632512:0@lo:400:kworker.0 00000100:00100000:2.0:1788529916.195757:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.195828:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.195872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.195918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.195946:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.195986:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379520 00000100:00100000:2.0:1788529916.195996:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379520 00000100:00100000:2.0:1788529916.196048:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 343 00000100:00100000:2.0:1788529916.196061:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158379520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529916.196136:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2357:x1875409158379520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.196157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 343 00000100:00100000:2.0:1788529916.196207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379648 00000100:00100000:2.0:1788529916.196212:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379648 00000100:00100000:2.0:1788529916.196244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158380032 00000100:00100000:2.0:1788529916.196247:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158380032 00000100:00100000:2.0:1788529916.196267:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:2.0:1788529916.196273:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2357:x1875409158379648:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529916.196304:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:2357:x1875409158379648:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 31us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.196311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:2.0:1788529916.196323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:2.0:1788529916.196329:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2357:x1875409158380032:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788529916.196371:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38bca45c-488d-404b-89e3-533f2a694da6+6:2357:x1875409158380032:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 42us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.196377:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:1.0:1788529916.196591:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379904 00000100:00100000:1.0:1788529916.196596:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379904 00000100:00100000:1.0:1788529916.196632:0:12086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158379776 00000100:00100000:1.0:1788529916.196636:0:12086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158379776 00000100:00100000:1.0:1788529916.196658:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:1.0:1788529916.196664:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2357:x1875409158379904:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529916.196696:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+7:2357:x1875409158379904:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529916.196702:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:1.0:1788529916.196714:0:12086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:1.0:1788529916.196720:0:12086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158379776:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1788529916.196742:0:12086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14b4f045-1109-44f4-a991-3ed448c68aea+5:2357:x1875409158379776:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529916.196747:0:12086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00080000:3.0:1788529916.197367:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788529916.197373:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529916.197375:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788529916.237078:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529916.674933:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529916.675063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158380288 00000100:00100000:1.0:1788529916.675075:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158380288 00000100:00100000:1.0:1788529916.675141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:1.0:1788529916.675152:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+19:12342:x1875409158380288:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1788529916.675552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:12342:x1875409158380288:12345-192.168.201.52@tcp:35:umount.0 Request processed in 400us (662us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788529916.675560:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1788529916.680136:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529916.680812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158380544 00000100:00100000:1.0:1788529916.680823:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158380544 00000100:00100000:1.0:1788529916.680880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:1.0:1788529916.680890:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+20:12342:x1875409158380544:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1788529916.681281:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:12342:x1875409158380544:12345-192.168.201.52@tcp:35:umount.0 Request processed in 390us (1154us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788529916.681302:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1788529916.685817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529916.686697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158380800 00000100:00100000:1.0:1788529916.686710:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158380800 00000100:00100000:1.0:1788529916.686775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1788529916.686786:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedf3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+21:12342:x1875409158380800:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1788529916.687116:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedf3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+22:12342:x1875409158380800:12345-192.168.201.52@tcp:35:umount.0 Request processed in 331us (1309us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788529916.687125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1788529916.700131:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529916.701728:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381056 00000100:00100000:1.0:1788529916.701742:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381056 00000100:00100000:1.0:1788529916.701816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1788529916.701827:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+22:12342:x1875409158381056:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:1.0:1788529916.702238:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14b4f045-1109-44f4-a991-3ed448c68aea+23:12342:x1875409158381056:12345-192.168.201.52@tcp:35:umount.0 Request processed in 411us (2117us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788529916.702246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:0.0:1788529916.706515:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529916.706564:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529916.706606:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529916.706880:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529916.713231:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.714144:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381312 00000100:00100000:2.0:1788529916.714162:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381312 00000100:00100000:2.0:1788529916.718735:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381568 00000100:00100000:2.0:1788529916.718754:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381568 00000100:00100000:2.0:1788529916.719003:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381184 00000100:00100000:2.0:1788529916.719008:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381184 00000100:00100000:2.0:1788529916.719025:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381440 00000100:00100000:2.0:1788529916.719028:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381440 00000100:00100000:2.0:1788529916.719052:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1788529916.719063:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+17:2356:x1875409158381312:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529916.719085:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529916.719111:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61dfc00/0xaa46022e3f18af6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0c90 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.719137:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529916.719250:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+16:2356:x1875409158381312:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 188us (12751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.719259:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1788529916.719284:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1788529916.719291:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+15:2356:x1875409158381568:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529916.719302:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529916.719338:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7000/0xaa46022e3f18b02c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ccf expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.719351:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529916.719373:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+14:2356:x1875409158381568:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 83us (12809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.719381:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1788529916.719983:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1788529916.719992:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+13:2356:x1875409158381184:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529916.720004:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529916.720015:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48a00/0xaa46022e3f18b025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cc8 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.720025:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529916.720045:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+12:2356:x1875409158381184:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 56us (13439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.720051:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1788529916.720064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1788529916.720069:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+11:2356:x1875409158381440:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529916.720078:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529916.720087:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61df400/0xaa46022e3f18b216 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d9a expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.720096:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529916.720114:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2356:x1875409158381440:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 44us (13235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.720120:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1788529916.721375:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158381952 00000100:00100000:2.0:1788529916.721391:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158381952 00000100:00100000:2.0:1788529916.721540:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:2.0:1788529916.721550:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+7:2353:x1875409158381952:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:2.0:1788529916.721591:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b565 00000020:00010000:2.0:1788529916.721603:0:6688:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cabfc238800: total 0 00000100:00080000:2.0:1788529916.721608:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cabfc23b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788529916.721724:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788529916.723923:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14b4f045-1109-44f4-a991-3ed448c68aea+5:2353:x1875409158381952:12345-192.168.201.52@tcp:9:umount.0 Request processed in 2340us (11124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.723939:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000020:00010000:2.0:1788529916.724076:0:5817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cabfc238800: total 0 00010000:00010000:2.0:1788529916.724111:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cabfc238800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788529916.724192:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c03726/0xaa46022e3f18b908 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f6f expref: 4 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.724234:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0abb55f/0xaa46022e3f18bfa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da113d expref: 3 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.724250:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cabfc238800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788529916.724261:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529916.724263:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529916.724265:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529916.736340:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788529916.736470:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158382080 00000100:00100000:2.0:1788529916.736485:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158382080 00000100:00100000:2.0:1788529916.736561:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:2.0:1788529916.736573:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+5:2353:x1875409158382080:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:2.0:1788529916.736927:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b304 00000100:00080000:2.0:1788529916.736942:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8caac77af800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788529916.736998:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788529916.737376:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14b4f045-1109-44f4-a991-3ed448c68aea+2:2353:x1875409158382080:12345-192.168.201.52@tcp:9:umount.0 Request processed in 804us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529916.737386:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00010000:00010000:3.0:1788529916.737487:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529916.749496:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529916.750222:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383104 00000100:00100000:0.0:1788529916.750237:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383104 00000100:00100000:0.0:1788529916.750322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:0.0:1788529916.750334:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+23:2353:x1875409158383104:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:0.0:1788529916.750380:0:5829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af7d 00000020:00010000:0.0:1788529916.750398:0:5829:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8caac4dd6000: total 0 00000100:00080000:0.0:1788529916.750405:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8caac4dd6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788529916.750574:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788529916.751366:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14b4f045-1109-44f4-a991-3ed448c68aea+22:2353:x1875409158383104:12345-192.168.201.52@tcp:39:umount.0 Request processed in 1030us (1882us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788529916.751379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00000020:00010000:2.0:1788529916.752082:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8caac4dd6000: total 0 00010000:00010000:2.0:1788529916.752151:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8caac4dd6000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788529916.752203:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:2.0:1788529916.752209:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788529916.752222:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101a00/0xaa46022e3f18b286 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0daf expref: 21 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752256:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:2.0:1788529916.752259:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788529916.752264:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd6e00/0xaa46022e3f18b96a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f8b expref: 20 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752280:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529916.752283:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788529916.752287:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff37400/0xaa46022e3f18bf91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1136 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752304:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529916.752307:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529916.752311:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100e00/0xaa46022e3f18b8c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f5a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752355:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529916.752358:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788529916.752362:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100400/0xaa46022e3f18b8f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f68 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752374:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529916.752377:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788529916.752381:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49c00/0xaa46022e3f18bf59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1128 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752394:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529916.752397:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788529916.752401:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18b5c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0e96 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752415:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc9230f00) 00010000:00010000:2.0:1788529916.752417:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788529916.752422:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18b26a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0da8 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752516:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529916.752520:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788529916.752525:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030600/0xaa46022e3f18bc65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1064 expref: 13 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752540:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788529916.752543:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788529916.752554:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18b2da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0dc4 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752573:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529916.752576:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788529916.752580:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7800/0xaa46022e3f18be87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da10f0 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752595:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cabc8c54d00) 00010000:00010000:2.0:1788529916.752597:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788529916.752600:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabeff36a00/0xaa46022e3f18bf83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da112f expref: 10 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.752617:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cabc9230e00) 00010000:00010000:2.0:1788529916.752620:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788529916.752690:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabd2bd7600/0xaa46022e3f18b986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f92 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.753142:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cabc5e09400) 00010000:00010000:2.0:1788529916.753146:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788529916.753152:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df000/0xaa46022e3f18b7e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0f22 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529916.753178:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8caac4dd6000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788529916.753205:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529916.753208:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529916.753211:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529917.261372:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529917.517161:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529917.517188:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185632768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788529917.517265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529917.517510:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632768 00000100:00100000:0.0:1788529917.517520:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632768 00000100:00100000:0.0:1788529917.517596:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788529917.517607:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185632768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788529917.517640:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788529917.517849:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185632768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529917.517856:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788529917.517913:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788529917.522256:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185632768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788529918.285553:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529919.309432:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788529919.676708:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000001:00080000:3.0:1788529919.676737:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788529919.676759:0:5852:0:(genops.c:885:class_export_put()) final put ffff8caac4dd6000/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:3.0:1788529919.676785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4dd6000/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-MDT0000 00000020:00000080:3.0:1788529919.676865:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac4dd6800 for lustre-MDT0000 00000001:00100000:2.0:1788529919.681859:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:2.0:1788529919.681872:0:7643:0:(genops.c:885:class_export_put()) final put ffff8cabfc238800/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:2.0:1788529919.681945:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfc238800/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-OST0001 00000020:00000080:2.0:1788529919.682024:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabfc23b000 for lustre-OST0001 00000001:00100000:1.0:1788529919.701852:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:1.0:1788529919.701867:0:6711:0:(genops.c:885:class_export_put()) final put ffff8cabc61f6800/14b4f045-1109-44f4-a991-3ed448c68aea 00000020:00000080:1.0:1788529919.701965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc61f6800/14b4f045-1109-44f4-a991-3ed448c68aea for lustre-OST0000 00000020:00000080:1.0:1788529919.702060:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac77af800 for lustre-OST0000 00000100:00100000:0.0:1788529920.028403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529920.028495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529920.028526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529920.028559:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529920.028597:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788529920.028640:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383232 00000100:00100000:0.0:1788529920.028653:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383232 00000100:00100000:0.0:1788529920.028714:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383488 00000100:00100000:0.0:1788529920.028717:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383488 00000100:00100000:0.0:1788529920.028731:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383360 00000100:00100000:0.0:1788529920.028734:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383360 00000100:00100000:0.0:1788529920.028743:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383616 00000100:00100000:0.0:1788529920.028745:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383616 00000100:00100000:0.0:1788529920.028762:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788529920.028773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bccf9d7-1f26-4f23-8349-edc335a13477+13:2357:x1875409158383232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788529920.028792:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529920.028816:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e3800/0xaa46022e3f18b072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0ce4 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529920.028841:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529920.028940:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bccf9d7-1f26-4f23-8349-edc335a13477+12:2357:x1875409158383232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 168us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529920.028949:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1788529920.029212:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1788529920.029224:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+11:2357:x1875409158383488:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529920.029233:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529920.029244:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18b20f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d93 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529920.029254:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529920.029275:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+10:2357:x1875409158383488:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 55us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.029282:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1788529920.029298:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1788529920.029304:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+9:2357:x1875409158383360:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529920.029311:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529920.029320:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2600/0xaa46022e3f18b079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0d0e expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529920.029331:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529920.029349:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+8:2357:x1875409158383360:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 45us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.029355:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1788529920.029366:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1788529920.029372:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+7:2357:x1875409158383616:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788529920.029392:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529920.029401:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabd2bd7a00/0xaa46022e3f18b06b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da0cdd expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529920.029411:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529920.029430:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bccf9d7-1f26-4f23-8349-edc335a13477+6:2357:x1875409158383616:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 58us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.029436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1788529920.029624:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158383872 00000100:00100000:2.0:1788529920.029630:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158383872 00000100:00100000:2.0:1788529920.029689:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:2.0:1788529920.029697:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+6:2353:x1875409158383872:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:2.0:1788529920.029742:0:7603:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18b087 00000020:00010000:2.0:1788529920.029752:0:7603:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cabc8535000: total 0 00000100:00080000:2.0:1788529920.029759:0:7603:0:(import.c:65:import_set_state_nolock()) ffff8cabc8532800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788529920.029788:0:7603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:3.0:1788529920.030071:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788529920.030117:0:5817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cabc8535000: total 0 00010000:00010000:3.0:1788529920.030123:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529920.030184:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cabc8535000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788529920.030228:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc9230000) 00010000:00010000:3.0:1788529920.030233:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788529920.030246:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabfc242400/0xaa46022e3f18bfb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1144 expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529920.030280:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cabc8535000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788529920.030310:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529920.030312:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529920.030314:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529920.030777:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38bca45c-488d-404b-89e3-533f2a694da6+3:2353:x1875409158383872:12345-192.168.201.52@tcp:39:umount.0 Request processed in 1076us (2173us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788529920.030788:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:0.0:1788529920.060794:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788529920.060948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384000 00000100:00100000:1.0:1788529920.060960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384000 00000100:00100000:1.0:1788529920.061018:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 344 00000100:00100000:1.0:1788529920.061029:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+6:2353:x1875409158384000:12345-192.168.201.52@tcp:251:umount.0 00000020:00000080:1.0:1788529920.061077:0:5823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af5a 00000100:00080000:1.0:1788529920.061087:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8caac437c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788529920.061168:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bccf9d7-1f26-4f23-8349-edc335a13477+1:2353:x1875409158384000:12345-192.168.201.52@tcp:251:umount.0 Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529920.061176:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 344 00000020:00000080:1.0:1788529920.061189:0:5823:0:(genops.c:885:class_export_put()) final put ffff8caac437d000/6bccf9d7-1f26-4f23-8349-edc335a13477 00000020:00000080:1.0:1788529920.061231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac437d000/6bccf9d7-1f26-4f23-8349-edc335a13477 for MGS 00000020:00000080:1.0:1788529920.061272:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac437c000 for MGS 00010000:00010000:0.0:1788529920.061555:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529920.333797:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529920.589214:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185633152:0@lo:400:kworker.0 00000100:00100000:0.0:1788529920.589317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529920.589426:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185633280:0@lo:400:kworker.0 00000100:00100000:1.0:1788529920.589470:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185632896:0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.589554:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185633024:0@lo:400:kworker.0 00000100:00100000:3.0:1788529920.591604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529920.591698:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633280 00000100:00100000:3.0:1788529920.591707:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633280 00000100:00100000:3.0:1788529920.591783:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788529920.591795:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529920.591853:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185633280:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529920.591860:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788529920.591881:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788529920.591943:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185633280:0@lo:400:kworker.0 00000100:00100000:1.0:1788529920.592250:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529920.592279:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185633408:0@lo:400:kworker.0 00000100:00100000:1.0:1788529920.592318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529920.592478:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633152 00000100:00100000:1.0:1788529920.592483:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633152 00000100:00100000:1.0:1788529920.592512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633408 00000100:00100000:1.0:1788529920.592515:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633408 00000100:00100000:1.0:1788529920.592537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788529920.592543:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185633152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529920.592579:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185633152:12345-0@lo:400:kworker.0 Request processed in 36us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529920.592584:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788529920.592613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788529920.592619:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185633408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529920.592652:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185633408:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529920.592658:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788529920.592682:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185633408:0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.592843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529920.592864:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185633536:0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.592888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529920.592934:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529920.592939:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185633664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529920.592962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529920.593000:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633536 00000100:00100000:2.0:1788529920.593004:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633536 00000100:00100000:2.0:1788529920.593032:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788529920.593038:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185633536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.593073:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185633536:12345-0@lo:400:kworker.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.593079:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788529920.593096:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633024 00000100:00100000:2.0:1788529920.593112:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633024 00000100:00100000:2.0:1788529920.593135:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788529920.593142:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185633024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.593173:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185633024:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.593179:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788529920.593198:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633664 00000100:00100000:2.0:1788529920.593201:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633664 00000100:00100000:2.0:1788529920.593228:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788529920.593236:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185633664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788529920.593261:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788529920.593290:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfce29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185633664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529920.593477:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788529920.593519:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185633664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788529920.593531:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185633024:0@lo:400:kworker.0 00000100:00100000:2.0:1788529920.593541:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788529920.593662:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185633152:0@lo:400:kworker.0 00000100:00100000:3.0:1788529920.593786:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185632896 00000100:00100000:3.0:1788529920.593792:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185632896 00000100:00100000:3.0:1788529920.593820:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788529920.593827:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529920.593871:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185632896:12345-0@lo:400:kworker.0 Request processed in 45us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529920.593878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:3.0:1788529920.594077:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788529920.594081:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529920.594115:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185632896:0@lo:400:kworker.0 00000040:00080000:0.0:1788529920.845158:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788529920.845180:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788529920.848441:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788529920.848470:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788529921.367693:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788529921.905679:0:12940:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:3.0:1788529921.919823:0:12940:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788529921.919875:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529921.919931:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529921.919939:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529921.919956:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529921.919972:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788529921.919978:0:12940:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788529921.920000:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788529921.920004:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788529921.920010:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788529921.920038:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788529921.920100:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185633792:0@lo:39:umount.0 00010000:00010000:0.0:1788529921.920102:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529921.920109:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.920116:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e2c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529921.920119:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.920127:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529921.920134:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529921.920139:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788529921.920141:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788529921.920143:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788529921.920171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788529921.920187:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.920194:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788529921.920222:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.920229:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2c00/0xaa46022e3f18affb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b002 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.920251:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529921.920252:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788529921.920253:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529921.920255:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529921.920261:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185633920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529921.920294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529921.920409:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633792 00000100:00100000:2.0:1788529921.920423:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633792 00000100:00100000:2.0:1788529921.920475:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788529921.920485:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875409185633792:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788529921.920508:0:7603:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ad15 00000100:00080000:2.0:1788529921.920525:0:7603:0:(import.c:65:import_set_state_nolock()) ffff8cabe4339800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788529921.920581:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1875409185633792:12345-0@lo:39:umount.0 Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529921.920588:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788529921.920600:0:7603:0:(genops.c:885:class_export_put()) final put ffff8cabe433d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788529921.920627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabe433d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788529921.920671:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabe4339800 for lustre-MDT0000 00010000:00010000:1.0:1788529921.920718:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788529921.920760:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788529921.920825:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185633792:0@lo:39:umount.0 00000100:00080000:2.0:1788529921.920872:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788529921.920875:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788529921.920879:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788529921.921971:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.921984:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.921990:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.921998:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922019:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788529921.922025:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922051:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922058:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922064:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922136:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788529921.922143:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922150:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922155:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.922161:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529921.922646:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185633920 00000100:00100000:0.0:1788529921.922659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185633920 00000100:00100000:0.0:1788529921.922716:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529921.922726:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3303:x1875409185633920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529921.922808:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529921.922826:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61dea00/0xaa46022e3f18b002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18affb expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.922843:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529921.922933:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+22:3303:x1875409185633920:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529921.922940:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529921.923031:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185633920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529921.923332:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788529921.923341:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923349:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e2200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529921.923353:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923361:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529921.923369:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529921.923391:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529921.923394:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 00010000:00010000:1.0:1788529921.923423:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923429:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529921.923463:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923469:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2200/0xaa46022e3f18b009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b010 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923481:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529921.923484:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923490:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529921.923493:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923499:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529921.923505:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529921.923511:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529921.923513:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788529921.923516:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788529921.923550:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923557:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529921.923576:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923583:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3200/0xaa46022e3f18af14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18af1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923592:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529921.923595:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923601:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529921.923603:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923610:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529921.923617:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529921.923623:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788529921.923625:0:5818:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788529921.923636:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923641:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529921.923646:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.923664:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529921.923666:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529921.923667:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529921.924282:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529921.924338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529921.924382:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788529921.924388:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529921.924408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529921.924574:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634176 00000100:00100000:1.0:1788529921.924583:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634176 00000100:00100000:1.0:1788529921.924621:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634304 00000100:00100000:1.0:1788529921.924624:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634304 00000100:00100000:1.0:1788529921.924644:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788529921.924652:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+23:3300:x1875409185634176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529921.924664:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529921.924677:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2e00/0xaa46022e3f18af1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18af14 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.924689:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529921.924721:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+22:3300:x1875409185634176:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529921.924728:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788529921.924816:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788529921.924822:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+21:3300:x1875409185634304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529921.924830:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788529921.924839:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18b240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18b239 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529921.924858:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788529921.924879:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3300:x1875409185634304:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529921.924885:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788529921.924946:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529921.924955:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529921.925055:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529921.925093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529921.925129:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634048 00000100:00100000:0.0:1788529921.925133:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634048 00000100:00100000:0.0:1788529921.925160:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529921.925168:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3303:x1875409185634048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529921.925177:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529921.925186:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49000/0xaa46022e3f18b010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18b009 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925208:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529921.925240:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72cd2bce-e770-4df8-80b5-9001b91d336b+19:3303:x1875409185634048:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529921.925246:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788529921.925272:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788529921.925423:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788529921.925432:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18b239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b240 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529921.925442:0:12940:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788529921.925470:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925485:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925493:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925498:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925519:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788529921.925525:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925531:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925538:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925544:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529921.925552:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788529921.925556:0:12940:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788529921.925570:0:12940:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788529921.925594:0:12940:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788529921.925598:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788529921.925603:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529921.925609:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788529921.925619:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cabfc23c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788529921.925625:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cabd1d07000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788529921.925631:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8cabc8535000 38bca45c-488d-404b-89e3-533f2a694da6 192.168.201.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788529921.925635:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cabfce30000) has exports, disconnecting them 00000020:00080000:2.0:1788529921.925639:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cabfc23c000), last request at 1788529920 00000020:00000080:2.0:1788529921.925645:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18aeb2 00000100:00080000:2.0:1788529921.925659:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8cabfc239000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788529921.925699:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cabfc23c000): rc 0 00000020:00000080:2.0:1788529921.925702:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfc23c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788529921.925712:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cabd1d07000), last request at 1788529920 00000020:00000080:2.0:1788529921.925716:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18adcb 00000100:00080000:2.0:1788529921.925723:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8cabd1d03000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788529921.925823:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788529921.925830:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925837:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529921.925841:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925849:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529921.925856:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529921.925861:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788529921.925864:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788529921.925866:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788529921.925918:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925925:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788529921.925940:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925956:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18ac74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18ac7b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925971:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529921.925974:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925980:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dee00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529921.925983:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.925989:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529921.925995:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529921.926001:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788529921.926003:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788529921.926006:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788529921.926031:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.926038:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788529921.926045:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.926051:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabf61dee00/0xaa46022e3f18b017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b01e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.926072:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529921.926086:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529921.926089:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529921.926102:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529921.926138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529921.926160:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529921.926166:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529921.926188:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529921.926213:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634560 00000100:00100000:0.0:1788529921.926218:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634560 00000100:00100000:0.0:1788529921.926246:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634432 00000100:00100000:0.0:1788529921.926250:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634432 00000100:00100000:0.0:1788529921.926268:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788529921.926275:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+20:3303:x1875409185634560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529921.926285:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529921.926295:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2000/0xaa46022e3f18b01e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18b017 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.926306:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529921.926335:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+19:3303:x1875409185634560:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529921.926341:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788529921.926354:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529921.926359:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+18:3303:x1875409185634432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529921.926366:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529921.926374:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030800/0xaa46022e3f18ac7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18ac74 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529921.926390:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788529921.926412:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72cd2bce-e770-4df8-80b5-9001b91d336b+17:3303:x1875409185634432:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529921.926419:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788529921.926450:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529921.926459:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72cd2bce-e770-4df8-80b5-9001b91d336b:3303:1875409185634560:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788529921.926538:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cabd1d07000): rc 0 00000020:00000080:2.0:1788529921.926541:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabd1d07000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788529921.926550:0:12940:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5a9c1b9fae0 00000100:00080000:2.0:1788529921.926575:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788529921.926579:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788529921.926600:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788529921.926658:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788529921.926672:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8caac43de000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788529921.926685:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788529921.926687:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788529921.926695:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788529921.926831:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788529921.926842:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8caac6f62800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788529921.926873:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cabfce30000) has no exports 00010000:00010000:1.0:1788529921.927010:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788529921.927137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfc23c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788529921.927185:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabd1d07000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788529921.927203:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabfc239000 for lustre-MDT0000 00000020:00000080:1.0:1788529921.927207:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabd1d03000 for lustre-MDT0000 00000100:00100000:1.0:1788529921.927222:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185634688:0@lo:9:umount.0 00000100:00100000:1.0:1788529921.927260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529921.927284:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185634816:0@lo:9:umount.0 00000100:00100000:1.0:1788529921.927302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529921.927338:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634688 00000100:00100000:1.0:1788529921.927342:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634688 00000100:00100000:1.0:1788529921.927374:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634816 00000100:00100000:1.0:1788529921.927376:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634816 00000100:00100000:1.0:1788529921.927395:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788529921.927402:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875409185634688:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788529921.927426:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ae26 00000100:00080000:1.0:1788529921.927434:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8caac437b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788529921.927461:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788529921.927923:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1875409185634688:12345-0@lo:9:umount.0 Request processed in 519us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529921.927942:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788529921.927958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788529921.927965:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf6125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875409185634816:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788529921.927978:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af45 00000100:00080000:1.0:1788529921.927985:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8caac4dd5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788529921.928004:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788529921.928207:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf6125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1875409185634816:12345-0@lo:9:umount.0 Request processed in 242us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529921.928214:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788529921.928255:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac43de000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788529921.928264:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788529921.928266:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788529921.928270:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185634688:0@lo:9:umount.0 00000100:00080000:1.0:1788529921.928281:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac6f62800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788529921.928288:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788529921.928289:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788529921.928291:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185634816:0@lo:9:umount.0 00010000:00010000:1.0:1788529921.928321:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529921.928394:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529921.930219:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788529921.936660:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cabfce30000) has no exports 00000020:00000080:2.0:1788529921.991596:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18accf 00000020:00000080:2.0:1788529921.991612:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabf5a2b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788529921.991720:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788529921.995651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf5a2b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788529921.996260:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788529921.996271:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788529921.996275:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cabc2e93310) has no exports 00000020:00000080:3.0:1788529921.998973:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18acc8 00000020:00000080:3.0:1788529921.998990:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfded3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788529921.999113:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788529921.999124:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788529921.999127:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfded7800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788529921.999130:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfded7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788529921.999143:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788529921.999324:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfded3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788529922.383330:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529923.405556:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529924.429339:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788529924.787102:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38bca45c-488d-404b-89e3-533f2a694da6 00000001:00080000:3.0:1788529924.787120:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788529924.787136:0:5852:0:(genops.c:885:class_export_put()) final put ffff8cabc8535000/38bca45c-488d-404b-89e3-533f2a694da6 00000020:00000080:2.0:1788529924.787304:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc8535000/38bca45c-488d-404b-89e3-533f2a694da6 for lustre-MDT0000 00000020:00000080:2.0:1788529924.787358:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc8532800 for lustre-MDT0000 00000001:00100000:2.0:1788529924.793664:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788529924.793674:0:7643:0:(genops.c:885:class_export_put()) final put ffff8caac4dd0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788529924.793993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4dd0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788529924.800492:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac4dd5000 for lustre-OST0001 00000001:00100000:1.0:1788529924.800579:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788529924.800583:0:6711:0:(genops.c:885:class_export_put()) final put ffff8caac437f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788529924.800612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac437f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788529924.800811:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac437b000 for lustre-OST0000 00010000:00010000:1.0:1788529925.456841:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529925.709881:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634944:0@lo:400:kworker.0 00000100:00100000:2.0:1788529925.709973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529925.710046:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529925.710053:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185635072:0@lo:400:kworker.0 00000100:00100000:2.0:1788529925.710080:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529925.710123:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185635072 00000100:00100000:2.0:1788529925.710130:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185635072 00000100:00100000:2.0:1788529925.710174:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788529925.710181:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875409185635072:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788529925.710189:0:5830:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788529925.710229:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875409185635072:12345-0@lo:400:kworker.0 Request processed in 46us (147us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788529925.710236:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788529925.710271:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788529925.710276:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788529925.710279:0:3300:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788529925.712236:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185635200:0@lo:400:kworker.0 00000100:00100000:3.0:1788529925.712312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529925.712375:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185635200 00000100:00100000:3.0:1788529925.712383:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185635200 00000100:00100000:3.0:1788529925.712418:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788529925.712424:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc75ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875409185635200:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788529925.712431:0:5831:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788529925.712465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc75ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875409185635200:12345-0@lo:400:kworker.0 Request processed in 40us (166us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788529925.712472:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788529925.712507:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788529925.712511:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788529925.712514:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788529925.712519:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788529925.712523:0:3302:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:3.0:1788529925.712528:0:3302:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cabfdede000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788529925.712555:0:3302:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabc75ee300 x1875409185635328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788529925.712574:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185635200:0@lo:400:kworker.0 00000100:00100000:1.0:1788529925.713041:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185634944 00000100:00100000:1.0:1788529925.713059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185634944 00000100:00100000:1.0:1788529925.713115:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788529925.713123:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:3300:x1875409185634944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529925.713178:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc33b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72cd2bce-e770-4df8-80b5-9001b91d336b+17:3300:x1875409185634944:12345-0@lo:400:kworker.0 Request processed in 57us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529925.713185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788529925.713218:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185635328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788529925.713242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529925.713274:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185635328 00000100:00100000:1.0:1788529925.713277:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185635328 00000100:00100000:1.0:1788529925.713308:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788529925.713313:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875409185635328:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788529925.713332:0:5830:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788529925.731842:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788529925.731853:0:3300:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 185 00000100:00080000:2.0:1788529925.731863:0:3300:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8caac4a2c800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529925.731938:0:3300:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc254380 x1875409185635456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788529925.731990:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185635072:0@lo:400:kworker.0 00000100:00100000:2.0:1788529925.732034:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185634944:0@lo:400:kworker.0 00000100:00100000:3.0:1788529925.748789:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185635456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788529925.748874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529925.749080:0:7603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185635456 00000100:00100000:2.0:1788529925.749098:0:7603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185635456 00000100:00100000:2.0:1788529925.749147:0:7603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788529925.749156:0:7603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875409185635456:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788529925.749721:0:7603:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788529925.749783:0:7603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875409185635456:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 626us (908us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788529925.749791:0:7603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788529925.749876:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788529925.749882:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788529925.749885:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185635456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788529925.774843:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875409185635328:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 61521us (61593us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788529925.774858:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788529925.775018:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788529925.775025:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788529925.775030:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabc75ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185635328:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788529926.477087:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529927.501797:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788529928.077412:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc61710c0 - data ffff8cabcfa9e870/ffff8caac5c7b400 00000020:01000000:3.0:1788529928.077553:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc51d7240 - data ffff8cabe6f57a20/ffff8cabc3266800 00000001:00000004:3.0:1788529928.089200:0:12940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788529928.185999:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788529928.186008:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788529928.186091:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788529928.186094:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788529928.189322:0:6911:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788529928.189330:0:6911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788529928.189341:0:6911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788529928.193387:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788529928.193394:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788529928.193444:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788529928.193447:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788529928.194342:0:7858:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788529928.194347:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788529928.194357:0:7858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788529928.258839:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ac97 00000020:00000080:2.0:1788529928.258851:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfce3c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788529928.261980:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18acac 00000020:00000080:2.0:1788529928.261992:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfce3b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788529928.262919:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce3c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788529928.263055:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788529928.263061:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.263071:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788529928.263076:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cabfce36620) has no exports 00000004:01000000:2.0:1788529928.263256:0:12940:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788529928.263378:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af3e 00000020:00000080:2.0:1788529928.263384:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabc61f1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788529928.263389:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788529928.263392:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.263398:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788529928.263401:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cabc2e91988) has no exports 00000020:00000080:2.0:1788529928.263407:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18af37 00000020:00000080:2.0:1788529928.263410:0:12940:0:(genops.c:885:class_export_put()) final put ffff8caac4efc000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788529928.264420:0:12940:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788529928.264426:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788529928.264430:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788529928.264436:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788529928.264439:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788529928.264483:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.264491:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788529928.264497:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ae1f 00000020:00000080:2.0:1788529928.264503:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfc740000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788529928.264510:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788529928.264515:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.264519:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788529928.264522:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cabc3eccc98) has no exports 00000020:00000080:2.0:1788529928.264526:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ae18 00000020:00000080:2.0:1788529928.264529:0:12940:0:(genops.c:885:class_export_put()) final put ffff8caac43df800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788529928.266199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce3b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788529928.266214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc61f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788529928.266220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4efc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788529928.266225:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac6f62800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788529928.266233:0:36:0:(genops.c:885:class_export_put()) final put ffff8cabf5665000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788529928.266236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf5665000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788529928.266240:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788529928.266322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfc740000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788529928.266327:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac43df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788529928.266381:0:12940:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788529928.266386:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788529928.266389:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788529928.266394:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788529928.266396:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788529928.266469:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.266487:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788529928.266515:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.266519:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788529928.266533:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabf402d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788529928.266536:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf402d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788529928.266541:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788529928.266697:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18acb3 00000020:00000080:2.0:1788529928.266704:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfce3b000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788529928.267558:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac43de000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788529928.267566:0:36:0:(genops.c:885:class_export_put()) final put ffff8caac4dd1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788529928.267568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4dd1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788529928.267573:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788529928.267799:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788529928.267805:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.267811:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788529928.267815:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cabfce31988) has no exports 00000020:00000080:2.0:1788529928.267836:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.267840:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788529928.267845:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18acba 00000020:00000080:2.0:1788529928.267849:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfce3f000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788529928.267856:0:12940:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabc80f0000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788529928.267859:0:12940:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabc80f0000 3 00000020:01000004:2.0:1788529928.267862:0:12940:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8cabc80f0000 from lustre-MDT0000 00000020:00000080:2.0:1788529928.267880:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.267884:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788529928.267886:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabfce38800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788529928.267889:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce38800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788529928.267946:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788529928.267989:0:12940:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788529928.267993:0:12940:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788529928.267996:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788529928.268000:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.268003:0:12940:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788529928.268009:0:12940:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cabd0beb000 72cd2bce-e770-4df8-80b5-9001b91d336b 0@lo 16 (0 0 11) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788529928.268015:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cabc7433310) has exports, disconnecting them 00000020:00080000:2.0:1788529928.268019:0:12940:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cabd0beb000), last request at 1788529654 00000020:00000080:2.0:1788529928.268032:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ac58 00000020:00010000:2.0:1788529928.268036:0:12940:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cabd0beb000: total 2 00000100:00080000:2.0:1788529928.268047:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8cabd0bea000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788529928.268104:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cabd0beb000): rc 0 00000020:00080000:2.0:1788529928.268109:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cabc7433310) has no exports 00000100:00100000:3.0:1788529928.268273:0:5822:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cabc3320c00:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1788529928.268391:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cabc3320600:5824] 2 exiting: rc = 0 00000020:00000080:3.0:1788529928.268437:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce3b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788529928.268441:0:36:0:(genops.c:885:class_export_put()) final put ffff8cabfce3f800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788529928.268449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce3f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788529928.268452:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788529928.268839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabfce3f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788529928.268871:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cabd0beb000: total 0 00010000:00010000:0.0:1788529928.268926:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cabd0beb000, canceled 0 locks, left on hash table 11. 00010000:00010000:0.0:1788529928.268955:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61df200/0xaa46022e3f18afae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afa7 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.268983:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2400/0xaa46022e3f18afca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afc3 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269008:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc13c8000/0xaa46022e3f18ad70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18ad69 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269022:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18afbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afb5 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269033:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61de000/0xaa46022e3f18b224 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18b21d expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269043:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc32e2800/0xaa46022e3f18aec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18aec0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269052:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18afd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afd1 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269062:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61de800/0xaa46022e3f18afe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afdf expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269071:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61dec00/0xaa46022e3f18aff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18afed expref: 4 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269082:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabf61de200/0xaa46022e3f18b232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18b22b expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269093:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030400/0xaa46022e3f18aee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa46022e3f18aedc expref: 2 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529928.269202:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cabd0beb000, canceled 11 locks, left on hash table 0. 00000020:00000080:0.0:1788529928.269215:0:8454:0:(genops.c:885:class_export_put()) final put ffff8cabd0beb000/72cd2bce-e770-4df8-80b5-9001b91d336b 00010000:00010000:0.0:1788529928.269258:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529928.269266:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529928.269268:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529928.269433:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cabc3321600:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1788529928.269823:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269831:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269837:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269843:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269849:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269854:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269859:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269864:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269869:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269875:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269881:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269886:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269924:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269931:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269936:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269942:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269948:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269953:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269959:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269972:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269978:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269984:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269990:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.269995:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270001:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270006:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270011:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270017:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270022:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270026:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270031:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270036:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270041:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270054:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270059:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270064:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270069:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270074:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270080:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270085:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270091:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270107:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270113:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270118:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270124:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270129:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270134:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270140:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270145:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270150:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270155:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270161:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270167:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270172:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270177:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270182:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270187:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270193:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270198:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270203:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270209:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270214:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270220:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529928.270226:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788529928.271031:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788529928.271036:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1788529928.271852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabd0beb000/72cd2bce-e770-4df8-80b5-9001b91d336b for MGS 00000020:00000080:3.0:1788529928.272723:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabd0bea000 for MGS 00000020:01000000:0.0:1788529928.272779:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8caac5d480c0 - data ffff8cabfaf5f510/ffff8caac5772800 00000020:01000000:0.0:1788529928.272914:0:12940:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc946ede0 - data ffff8cabe6f59360/ffff8cabc744d400 00000020:00000080:0.0:1788529928.273545:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ac3c 00000020:00000080:0.0:1788529928.273552:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabd54c7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788529928.273566:0:12940:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabc80f0000 from MGS, refs=2 00000020:01000004:0.0:1788529928.273570:0:12940:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabc80f0000 2 00000020:01000004:0.0:1788529928.273572:0:12940:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8cabc80f0000 from MGS 00000020:00000080:0.0:1788529928.273644:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788529928.273709:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788529928.273715:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabc80f1000/MGS 00000020:00000080:0.0:1788529928.273717:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc80f1000/MGS for MGS 00000020:01000000:0.0:1788529928.273724:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788529928.273781:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788529928.273786:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788529928.273792:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788529928.273798:0:12940:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cabc35b2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788529928.273804:0:12940:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8cabc7430000) has exports, disconnecting them 00000020:00080000:0.0:1788529928.273809:0:12940:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cabc35b2800), last request at 1788529655 00000020:00000080:0.0:1788529928.273814:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ad07 00000020:00080000:0.0:1788529928.273824:0:12940:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cabc35b2800): rc 0 00000020:00000080:0.0:1788529928.273829:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabc35b2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788529928.274012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabd54c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788529928.274401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc35b2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788529928.280993:0:12940:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788529928.281003:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788529928.281007:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788529928.281015:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788529928.281190:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.281198:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788529928.281205:0:12940:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabc80f0000 1 00000020:00000080:2.0:1788529928.281212:0:12940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ac2e 00000020:00000080:2.0:1788529928.281221:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabc80f6000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788529928.281229:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788529928.281234:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529928.281238:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788529928.281242:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cabc7434c98) has no exports 00000020:00000080:3.0:1788529928.281360:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc35b5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788529928.281367:0:36:0:(genops.c:885:class_export_put()) final put ffff8cabc35b0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788529928.281370:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc35b0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788529928.281376:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788529928.281439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc80f6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788529928.331297:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788529928.331311:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788529928.331316:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabc80f3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788529928.331321:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc80f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788529928.331328:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788529928.331483:0:12940:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8cabc80f7800 00000020:01000000:3.0:1788529928.331508:0:12940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788529928.331513:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788529928.331517:0:12940:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788529928.336201:0:12940:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cabc2e94c98) has no exports 00000100:00100000:0.0:1788529928.336444:0:5829:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cabc7dcda00:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1788529928.337247:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cabc3fe5000:5831] 2 exiting: rc = 0 00000100:00100000:2.0:1788529928.337322:0:7603:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cabfdec8e00:7603] 3 exiting: rc = 0 00000100:00100000:2.0:1788529928.337379:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cabc2e1a200:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1788529928.337513:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337531:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337538:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337545:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337550:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337556:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337561:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337567:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337592:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337598:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337604:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337609:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337614:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337619:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337635:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337641:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337647:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337652:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337658:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337663:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337667:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337672:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337677:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337682:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337687:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337693:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337715:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337721:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337727:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337732:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337737:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337743:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337749:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337755:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337761:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337767:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337772:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337778:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337783:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337788:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337794:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337799:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337805:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337819:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337825:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337831:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337837:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337842:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337848:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337854:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337859:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337865:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337871:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337876:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337881:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337886:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337917:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337924:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337930:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337937:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337943:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337948:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337954:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.337961:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.347938:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cabc3fe5800:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1788529928.348746:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cabc334bc00:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788529928.348811:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348819:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348826:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348832:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348837:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348842:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348847:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348852:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348857:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348862:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348867:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348873:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348880:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348917:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348923:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348928:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348933:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348939:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348945:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348950:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348955:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348960:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348976:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348981:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348986:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348990:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.348996:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349001:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349007:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349012:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349016:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349021:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349026:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349031:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349036:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349040:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349045:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349051:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349055:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349060:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349065:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349070:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349074:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349079:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349084:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349089:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349256:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349265:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349276:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349281:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349286:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349292:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349297:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349302:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349317:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349323:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349329:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349334:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349340:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349344:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349349:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349360:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.349365:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.351431:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cabc2e28400:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1788529928.351727:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cabc2e1bc00:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788529928.352087:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352193:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352201:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352207:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352213:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352218:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352224:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352230:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352236:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352242:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352250:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352255:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352274:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352293:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352301:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352306:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352312:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352319:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352324:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352330:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352336:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352342:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352348:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352360:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352379:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352386:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352393:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352398:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352405:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352411:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352418:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352424:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352430:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352438:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352444:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352450:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352529:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352538:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352544:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352554:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352561:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352566:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352572:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352633:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352643:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352648:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352662:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352666:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352685:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352692:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352698:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352704:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352711:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352717:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352722:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352727:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352733:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352739:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352743:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352749:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352769:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352776:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.352782:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.366352:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cabc2e29200:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1788529928.367486:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cabc334b000:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1788529928.367744:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367751:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367756:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367761:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367766:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367770:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367775:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367780:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367785:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367790:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367796:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367801:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367806:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367811:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367817:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367822:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367826:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367832:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367848:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367853:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367858:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367863:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367868:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367873:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367887:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367918:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367923:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367928:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367932:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367937:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367942:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367947:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367951:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367955:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367960:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367976:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367981:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367987:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367992:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.367997:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368002:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368007:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368012:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368017:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368022:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368026:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368031:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368036:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368041:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368045:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368050:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368055:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368059:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368071:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368076:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368081:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368086:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.368090:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371383:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371401:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371406:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371410:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371415:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.371420:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.372255:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cabc3205600:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1788529928.374080:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cabc3205200:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1788529928.374677:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374684:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374689:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374704:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374710:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374715:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374721:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374726:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374732:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374738:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374743:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374747:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374752:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374757:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374762:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374767:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374773:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374778:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374783:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374788:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374793:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374798:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374803:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374820:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374825:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374830:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374835:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374840:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374845:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374850:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374856:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374861:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374866:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374871:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374875:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374880:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374885:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374919:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374927:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374933:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374938:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374943:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374948:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374953:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374959:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374972:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374979:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374984:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374989:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374994:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.374999:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375004:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375009:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375014:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375020:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375025:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375030:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375035:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375048:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375053:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375058:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375063:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375068:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375073:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788529928.375625:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cabc35ef200:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1788529928.375721:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cabc35efc00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788529928.375990:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.375996:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376001:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376005:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376010:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376016:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376020:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376025:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376029:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376034:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376038:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376043:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376048:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376053:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376059:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376064:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376069:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376074:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376079:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376084:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376090:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376105:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376112:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376117:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376123:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376128:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376133:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376138:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376143:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376157:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376163:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376168:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376173:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376177:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376183:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376188:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376193:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376199:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376204:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376208:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376214:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376218:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376223:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376227:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376232:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376237:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376242:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376247:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376252:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376257:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376262:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376267:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376272:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376277:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376282:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376287:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376292:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376297:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376301:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376306:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376311:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376316:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376322:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.376327:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.377076:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cabc2e81200:5844] 2 exiting: rc = 0 00000100:00100000:3.0:1788529928.377326:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cabc2e80400:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1788529928.377460:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cabc2e81c00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788529928.379090:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379105:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379114:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379120:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379125:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379131:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379136:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379142:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379148:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379155:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379161:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379167:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379173:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379179:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379185:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379190:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379207:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379213:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379220:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379246:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379254:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379265:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379271:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379277:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379282:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379288:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379294:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379300:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379305:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379311:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379317:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379323:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379328:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379335:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379360:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379365:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379371:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379377:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379383:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379388:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379394:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379400:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379422:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379429:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379435:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379441:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379446:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379451:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379457:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379463:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379468:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379473:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379479:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379484:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379490:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379495:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379500:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379506:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379511:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379517:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379523:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379529:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529928.379534:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788529928.396797:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529928.396813:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788529928.396820:0:12940:0:(genops.c:885:class_export_put()) final put ffff8cabd1d03800/MDS_uuid 00000020:00000080:2.0:1788529928.396825:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabd1d03800/MDS_uuid for MDS 00000020:01000000:2.0:1788529928.396835:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788529928.397015:0:12940:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788529928.526481:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529929.549218:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529930.573055:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788529930.831688:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788529930.831695:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788529930.831699:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788529930.831707:0:12190:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788529930.831713:0:12190:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788529930.831720:0:12190:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8caac4a2c800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529930.831740:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8caac779e300 x1875409185635712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788529930.831775:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788529930.831778:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788529930.831780:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788529930.831784:0:12190:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788529930.831786:0:12190:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788529930.831790:0:12190:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cabfdede000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529930.831803:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8caac779c000 x1875409185635840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788529930.831827:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529930.831843:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185635584:0@lo:400:kworker.0 00000400:00000100:0.0:1788529930.831889:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409185635584 offset 0 length 224: 4 00000100:00100000:0.0:1788529930.832249:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185635712:0@lo:38:kworker.0 00000400:00000100:0.0:1788529930.832272:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409185635712 offset 0 length 520: 4 00000100:00100000:0.0:1788529930.832286:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185635840:0@lo:38:kworker.0 00000400:00000100:0.0:1788529930.832300:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409185635840 offset 0 length 520: 4 00010000:00010000:2.0:1788529931.602534:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529932.640012:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788529933.567717:0:13095:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:0.0:1788529933.593233:0:13095:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788529933.593285:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.593299:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.593307:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.593331:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.593357:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788529933.593378:0:13095:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-client 10000000:01000000:0.0:1788529933.593383:0:13095:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788529933.593404:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788529933.593415:0:13095:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8caac779e300 x1875409185635712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788529945 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529933.593434:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788529933.593466:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788529933.593471:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1788529933.593475:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185635712:0@lo:38:kworker.0 00000100:00080000:0.0:1788529933.593503:0:13095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788529933.593507:0:13095:0:(import.c:65:import_set_state_nolock()) ffff8caac4a2c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788529933.593512:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788529933.593514:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788529933.593518:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788529933.594657:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529933.594668:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529933.594678:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529933.594682:0:8454:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529933.594693:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529933.594700:0:8454:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529933.594716:0:8454:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529933.594719:0:8454:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788529933.594722:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788529933.594787:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529933.594794:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529933.594826:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529933.594834:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3a00/0xaa46022e3f18afd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afd8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529933.594847:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529933.594849:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529933.594851:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529933.594859:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529933.594910:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185635968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529933.594974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529933.595043:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185635968 00000100:00100000:1.0:1788529933.595050:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185635968 00000100:00100000:1.0:1788529933.595087:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788529933.595094:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3301:x1875409185635968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788529933.595100:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788529933 with bad export cookie 12269496632467827800 00010000:00010000:0.0:1788529933.597409:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597428:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597435:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597460:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597483:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788529933.597503:0:13095:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-OST0000 00010000:00010000:0.0:1788529933.597509:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597516:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597522:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597528:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597540:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788529933.597546:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597552:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.597558:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599297:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599336:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788529933.599353:0:13095:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear params 00010000:00010000:0.0:1788529933.599360:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599367:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599373:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599378:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529933.599385:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788529933.599442:0:13095:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788529933.599445:0:13095:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788529933.599468:0:13095:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788529933.599474:0:13095:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788529933.599479:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788529933.599484:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788529933.599489:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8caac4a39988) has no exports 00000020:00080000:0.0:1788529933.599514:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8caac4a39988) has no exports 00010000:00010000:3.0:1788529933.600216:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788529933.600225:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600234:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfa00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529933.600238:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600248:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529933.600263:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529933.600269:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788529933.600272:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 10000000:01000000:3.0:1788529933.600274:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788529933.600330:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600337:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529933.600358:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600364:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabf61dfa00/0xaa46022e3f18afdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18afe6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600376:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788529933.600379:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600384:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031800 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529933.600387:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600393:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529933.600399:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529933.600415:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788529933.600417:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788529933.600419:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788529933.600442:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600448:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529933.600466:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600472:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0031800/0xaa46022e3f18aedc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600483:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529933.600486:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600492:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529933.600495:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600501:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529933.600507:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529933.600512:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788529933.600514:0:5818:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788529933.600516:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788529933.600548:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.600554:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529933.600560:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600665:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529933.600671:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600678:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e3400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529933.600681:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600689:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529933.600695:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529933.600700:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788529933.600702:0:5817:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788529933.600704:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788529933.600732:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600738:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788529933.600744:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600751:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e3400/0xaa46022e3f18afed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18aff4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529933.600762:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529933.600764:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529933.600772:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529933.604811:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030000/0xaa46022e3f18b22b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa46022e3f18b232 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529933.604842:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529933.604844:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529933.604846:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529933.604870:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185636480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529933.604985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529933.605847:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529933.605857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185636096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529933.606684:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529933.606739:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185636224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529933.607663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529933.607692:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788529933.607699:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185636352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529933.607717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529933.607744:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636480 00000100:00100000:3.0:1788529933.607766:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636480 00000100:00100000:3.0:1788529933.607799:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636096 00000100:00100000:3.0:1788529933.607802:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636096 00000100:00100000:3.0:1788529933.607810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636224 00000100:00100000:3.0:1788529933.607812:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636224 00000100:00100000:3.0:1788529933.607818:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636352 00000100:00100000:3.0:1788529933.607834:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636352 00000100:00100000:3.0:1788529933.607851:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529933.607858:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc3efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1875409185636480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788529933.607865:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788529933 with bad export cookie 12269496632467827800 00000100:00100000:3.0:1788529933.607949:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc3efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1875409185636480:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2963us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788529933.607956:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788529933.607974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529933.607978:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1875409185636096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788529933.607983:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788529933 with bad export cookie 12269496632467827800 00000100:00100000:3.0:1788529933.613036:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1875409185636096:12345-0@lo:103:ldlm_bl.0 Request processed in 5045us (6343us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788529933.613052:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529933.613089:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529933.613095:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875409185636224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788529933.613102:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788529933 with bad export cookie 12269496632467827800 00000100:00100000:3.0:1788529933.613184:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875409185636224:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (5521us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788529933.613190:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529933.613202:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788529933.613206:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875409185636352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788529933.613210:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788529933 with bad export cookie 12269496632467827800 00000100:00100000:3.0:1788529933.613234:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875409185636352:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (5516us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788529933.613240:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788529933.613285:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788529933.613304:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8cabc35fc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788529933.613307:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1788529933.613725:0:13095:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc7de56c0 - data ffff8cabfaf91798/ffff8cabfc6e5400 00000020:01000000:0.0:1788529933.613922:0:13095:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc7de2900 - data ffff8cabcfaa4e58/ffff8caac4eee400 00000100:00080000:2.0:1788529933.614304:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1788529933.618453:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529933.618544:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3301:x1875409185635968:12345-0@lo:103:ldlm_bl.0 Request processed in 23444us (23566us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788529933.618555:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788529933.655214:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1788529933.658981:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788529933.659303:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.152@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788529933.659307:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788529933.659317:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8caac779ea00 x1875409185635584/t0(0) o400->MGC192.168.201.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788529946 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529933.659332:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfcb18e00 x1875409185635968/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788529949 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529933.659341:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfc254e00 x1875409185636480/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788529949 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529933.659350:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfc133480 x1875409185636096/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788529949 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529933.659357:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfc130700 x1875409185636224/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788529949 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529933.659364:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfc130e00 x1875409185636352/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788529949 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788529933.659372:0:3300:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788529933.659375:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788529933.659376:0:3300:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788529933.663354:0:3302:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cabc35fc800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788529933.663435:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185636224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788529933.663446:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185635584:0@lo:400:kworker.0 00000100:00100000:2.0:1788529933.663474:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72cd2bce-e770-4df8-80b5-9001b91d336b:3302:1875409185636352:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788529933.673116:0:3301:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cabc35fc800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788529933.673207:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72cd2bce-e770-4df8-80b5-9001b91d336b:3301:1875409185635968:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788529933.676688:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8cabc35fc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788529933.676701:0:3300:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:3.0:1788529933.676711:0:3300:0:(import.c:665:import_select_connection()) MGC192.168.201.152@tcp: import ffff8cabc35fc800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529933.676856:0:3300:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc254a80 x1875409185636608/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788529933.676937:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185636480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788529933.676965:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72cd2bce-e770-4df8-80b5-9001b91d336b:3300:1875409185636096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529933.677125:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72cd2bce-e770-4df8-80b5-9001b91d336b:3299:1875409185636608:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788529933.677181:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409185636608 offset 0 length 520: 4 00100000:10000000:2.0:1788529933.693515:0:13095:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788529933.752347:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ad8c 00000020:00000080:0.0:1788529933.752358:0:13095:0:(genops.c:885:class_export_put()) final put ffff8caac4a2e000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788529933.752418:0:13095:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabf402e800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788529933.752422:0:13095:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabf402e800 2 00000020:01000004:0.0:1788529933.752425:0:13095:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8cabf402e800 from lustre-OST0000 00000020:00000080:0.0:1788529933.752464:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788529933.752475:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788529933.752593:0:13095:0:(genops.c:885:class_export_put()) final put ffff8caac4a2b800/lustre-OST0000_UUID 00000020:00000080:0.0:1788529933.752597:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4a2b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788529933.752603:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788529933.752656:0:13095:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788529933.752660:0:13095:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788529933.752665:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788529933.752670:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788529933.752688:0:13095:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8caac43dd000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788529933.752695:0:13095:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8caac4a3cc98) has exports, disconnecting them 00000020:00080000:0.0:1788529933.752701:0:13095:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8caac43dd000), last request at 1788529676 00000020:00000080:0.0:1788529933.752705:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18adc4 00000020:00080000:0.0:1788529933.752714:0:13095:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8caac43dd000): rc 0 00000020:00000080:0.0:1788529933.752719:0:13095:0:(genops.c:885:class_export_put()) final put ffff8caac43dd000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788529933.756843:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4a2e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788529933.757554:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac43dd000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788529933.760972:0:13095:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788529933.760980:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788529933.760985:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788529933.760992:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788529933.761160:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788529933.761168:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788529933.761175:0:13095:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabf402e800 1 00000020:00000080:1.0:1788529933.761181:0:13095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ad46 00000020:00000080:1.0:1788529933.761189:0:13095:0:(genops.c:885:class_export_put()) final put ffff8cabf54e7000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788529933.761195:0:13095:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788529933.761202:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788529933.761205:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788529933.761208:0:13095:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cabfce34c98) has no exports 00000020:00000080:2.0:1788529933.761347:0:12190:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8caac4a2c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788529933.761355:0:12190:0:(genops.c:885:class_export_put()) final put ffff8caac4a2f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788529933.761358:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4a2f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788529933.761369:0:12190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788529933.761429:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf54e7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788529933.799282:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529933.799298:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788529933.799305:0:13095:0:(genops.c:885:class_export_put()) final put ffff8cabf402b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788529933.799309:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf402b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788529933.799320:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788529933.802516:0:13095:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8cabf402b000 00000020:02000400:2.0:1788529933.802584:0:13095:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788529934.670088:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529935.693256:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788529935.959271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72cd2bce-e770-4df8-80b5-9001b91d336b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788529935.959281:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 72cd2bce-e770-4df8-80b5-9001b91d336b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788529935.959284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788529935.959287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788529936.722760:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529937.743209:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788529938.252418:0:13246:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:3.0:1788529938.281859:0:13246:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788529938.287701:0:13246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.287724:0:13246:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.287750:0:13246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.287757:0:13246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.288157:0:13246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788529938.288179:0:13246:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-client 10000000:01000000:3.0:1788529938.288184:0:13246:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788529938.288205:0:13246:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788529938.288216:0:13246:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8caac779c000 x1875409185635840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788529945 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529938.288406:0:13246:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788529938.288414:0:13246:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788529938.288419:0:13246:0:(import.c:65:import_set_state_nolock()) ffff8cabfdede000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788529938.288424:0:13246:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788529938.288429:0:13246:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8caac779c000 x1875409185635840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788529945 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788529938.288526:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529938.288534:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.288542:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc32e2a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529938.288546:0:8454:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.288556:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529938.288562:0:8454:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529938.288569:0:8454:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788529938.288571:0:8454:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788529938.288574:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788529938.288600:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:2.0:1788529938.288603:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.288610:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc32e2a00/0xaa46022e3f18afa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afae expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.288622:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529938.288624:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529938.288625:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529938.290437:0:13246:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788529938.290497:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185635840:0@lo:38:kworker.0 00000100:00100000:3.0:1788529938.290622:0:13246:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788529938.292194:0:13246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292211:0:13246:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292219:0:13246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292439:0:13246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292492:0:13246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788529938.292513:0:13246:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-OST0001 00010000:00010000:3.0:1788529938.292519:0:13246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292526:0:13246:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292533:0:13246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292539:0:13246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292571:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529938.292578:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292585:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabd2bd7200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529938.292596:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292605:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529938.292612:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529938.292617:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529938.292619:0:5817:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:1.0:1788529938.292631:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:1.0:1788529938.292635:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292641:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd7200/0xaa46022e3f18afb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afbc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292656:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529938.292659:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292665:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529938.292667:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292674:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529938.292681:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529938.292697:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529938.292700:0:5817:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788529938.292705:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:1.0:1788529938.292708:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.292716:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529938.292717:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529938.292719:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529938.292778:0:13246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788529938.292783:0:13246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc0030a00/0xaa46022e3f18aec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18aec7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529938.292806:0:13246:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788529938.292831:0:13246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292839:0:13246:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292845:0:13246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.292856:0:13246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.292885:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529938.292918:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.292943:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48600 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:2.0:1788529938.292947:0:5818:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.292955:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529938.292961:0:5818:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529938.292967:0:5818:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788529938.292969:0:5818:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788529938.292974:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:2.0:1788529938.292976:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529938.292984:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529938.292985:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529938.292987:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529938.293169:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529938.293192:0:13246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788529938.293197:0:13246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48600/0xaa46022e3f18b21d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18b224 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529938.293214:0:13246:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear params 10000000:01000000:3.0:1788529938.293217:0:13246:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788529938.293542:0:13246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.293550:0:13246:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.293557:0:13246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.293563:0:13246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529938.293608:0:13246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788529938.293718:0:13246:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.201.152@tcp: clear lustre-sptlrpc 10000000:01000000:3.0:1788529938.293722:0:13246:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788529938.293733:0:13246:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788529938.293752:0:13246:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788529938.293757:0:13246:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788529938.293763:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788529938.293768:0:13246:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788529938.293778:0:13246:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cabc2e90000) has no exports 00000020:00080000:3.0:1788529938.293812:0:13246:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cabc2e90000) has no exports 00000020:01000000:3.0:1788529938.298061:0:13246:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc7de5f00 - data ffff8cabfaf910d8/ffff8cabf5ed7000 00010000:00010000:1.0:1788529938.298345:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529938.298355:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.298366:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529938.298370:0:5817:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.298380:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529938.298388:0:5817:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529938.298395:0:5817:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788529938.298397:0:5817:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788529938.298401:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788529938.298441:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:1.0:1788529938.298446:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.298472:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48c00/0xaa46022e3f18afc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18afca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529938.298487:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529938.298490:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529938.298491:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788529938.298532:0:13246:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cabc5c618a0 - data ffff8cabcfa81000/ffff8cabc8563c00 00100000:10000000:3.0:1788529938.317157:0:13246:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788529938.355678:0:13246:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ae73 00000020:00000080:2.0:1788529938.355693:0:13246:0:(genops.c:885:class_export_put()) final put ffff8cabf5661800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788529938.355717:0:13246:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8caac4efb800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788529938.355721:0:13246:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8caac4efb800 2 00000020:01000004:2.0:1788529938.355725:0:13246:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8caac4efb800 from lustre-OST0001 00000020:00000080:2.0:1788529938.355755:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529938.355766:0:13246:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788529938.355769:0:13246:0:(genops.c:885:class_export_put()) final put ffff8cabf5667800/lustre-OST0001_UUID 00000020:00000080:2.0:1788529938.355772:0:13246:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf5667800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788529938.355780:0:13246:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788529938.356037:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf5661800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788529938.356271:0:13246:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 72cd2bce-e770-4df8-80b5-9001b91d336b->MGS 00010000:00010000:2.0:1788529938.356291:0:13246:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788529938.356302:0:13246:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529938.356308:0:13246:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788529938.356311:0:13246:0:(mgc_request.c:1252:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788529938.356314:0:13246:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788529938.356339:0:13246:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cabc35fc800 00010000:00010000:2.0:1788529938.356343:0:13246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabd2bd6200/0xaa46022e3f18ad69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa46022e3f18ad70 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788529938.356363:0:13246:0:(import.c:65:import_set_state_nolock()) ffff8cabc35fc800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788529938.356367:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788529938.356370:0:13246:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788529938.356371:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788529938.356375:0:13246:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788529938.356388:0:13246:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cabfc254a80 x1875409185636608/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788529943 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788529938.356456:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788529938.356459:0:13246:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1788529938.359178:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72cd2bce-e770-4df8-80b5-9001b91d336b:3299:1875409185636608:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788529938.359272:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788529938.359286:0:13246:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ac4a 00000020:00000080:2.0:1788529938.359296:0:13246:0:(genops.c:885:class_export_put()) final put ffff8cabd1d04800/72cd2bce-e770-4df8-80b5-9001b91d336b 00000020:01000000:2.0:1788529938.359315:0:13246:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.152@tcp (flags='') 00000020:00000080:2.0:1788529938.359322:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529938.359328:0:13246:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788529938.359332:0:13246:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cabc7436620) has no exports 10000000:01000000:0.0:1788529938.359390:0:5827:0:(mgc_request.c:982:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788529938.359593:0:13246:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.201.152@tcp: client import never connected 00000100:00080000:2.0:1788529938.359597:0:13246:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788529938.359610:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788529938.359613:0:13246:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788529938.359616:0:13246:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788529938.359650:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788529938.359657:0:13246:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.152@tcp (uuid 72cd2bce-e770-4df8-80b5-9001b91d336b) 00000020:01000000:2.0:1788529938.359663:0:13246:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788529938.359666:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788529938.359670:0:13246:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788529938.359675:0:13246:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8caac4a29800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788529938.359680:0:13246:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8cabfce33310) has exports, disconnecting them 00000020:00080000:2.0:1788529938.359684:0:13246:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8caac4a29800), last request at 1788529698 00000020:00000080:2.0:1788529938.359688:0:13246:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18aeab 00000020:00080000:2.0:1788529938.359699:0:13246:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8caac4a29800): rc 0 00000020:00000080:2.0:1788529938.359703:0:13246:0:(genops.c:885:class_export_put()) final put ffff8caac4a29800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788529938.360441:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabd1d04800/72cd2bce-e770-4df8-80b5-9001b91d336b for MGC192.168.201.152@tcp 00000020:00000080:1.0:1788529938.360465:0:12190:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabc35fc800 for MGC192.168.201.152@tcp 00000020:00000080:1.0:1788529938.360471:0:12190:0:(genops.c:885:class_export_put()) final put ffff8cabc35ff000/72cd2bce-e770-4df8-80b5-9001b91d336b 00000020:00000080:1.0:1788529938.360473:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabc35ff000/72cd2bce-e770-4df8-80b5-9001b91d336b for MGC192.168.201.152@tcp 00000020:01000000:1.0:1788529938.360478:0:12190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.152@tcp (72cd2bce-e770-4df8-80b5-9001b91d336b) 00000020:00000080:1.0:1788529938.360732:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4a29800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788529938.367069:0:13246:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788529938.367079:0:13246:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788529938.367084:0:13246:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788529938.367091:0:13246:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788529938.367210:0:12190:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cabfdede000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788529938.371044:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788529938.371244:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788529938.371555:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788529938.371691:0:5812:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cabd5550800:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1788529938.378117:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cabd5551800:5813] 1 exiting: rc = 0 00000100:00100000:1.0:1788529938.378539:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.379154:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cabcfc63e00:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1788529938.379372:0:8455:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cabfc8b3c00:8455] 3 exiting: rc = 0 00000100:00100000:1.0:1788529938.380780:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cabcfc62e00:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1788529938.380924:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cabcfc63400:5816] 2 exiting: rc = 0 00000100:00100000:0.0:1788529938.381117:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381126:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381133:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381139:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381144:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381150:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381156:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381161:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381168:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381174:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381180:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381186:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381191:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381197:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381202:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381208:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381214:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381219:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381226:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381349:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381354:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381359:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381364:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381369:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381373:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381377:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381382:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381387:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381391:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381419:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381424:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381430:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381435:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381441:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381447:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381514:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381520:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381524:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381529:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381534:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381539:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381544:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381549:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381555:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381560:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381566:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381571:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381577:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381583:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381588:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381592:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381598:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381603:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381608:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381612:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381617:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381621:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381626:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381631:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381637:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381642:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381646:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381652:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.381658:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788529938.386132:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788529938.386145:0:13246:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788529938.386152:0:13246:0:(genops.c:885:class_export_put()) final put ffff8caac4378000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788529938.386156:0:13246:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4378000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788529938.386163:0:13246:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788529938.386217:0:13246:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8caac4efb800 1 00000020:00000080:0.0:1788529938.386224:0:13246:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa46022e3f18ae42 00000020:00000080:0.0:1788529938.386317:0:13246:0:(genops.c:885:class_export_put()) final put ffff8caac4a2d800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788529938.386337:0:13246:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788529938.386342:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788529938.386347:0:13246:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788529938.386351:0:13246:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cabc2e96620) has no exports 00000020:00000080:1.0:1788529938.386438:0:12190:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4a2d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788529938.445226:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788529938.445244:0:13246:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788529938.445250:0:13246:0:(genops.c:885:class_export_put()) final put ffff8caac4eff800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788529938.445255:0:13246:0:(genops.c:844:class_export_destroy()) destroying export ffff8caac4eff800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788529938.445263:0:13246:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788529938.445818:0:13246:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8caac4efe000 00000020:01000000:1.0:1788529938.445846:0:13246:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788529938.445862:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788529938.445867:0:13246:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788529938.445880:0:13246:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cabc7431988) has no exports 00000020:00000080:1.0:1788529938.445941:0:13246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788529938.445948:0:13246:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788529938.445952:0:13246:0:(genops.c:885:class_export_put()) final put ffff8cabf54e1800/OSS_uuid 00000020:00000080:1.0:1788529938.445954:0:13246:0:(genops.c:844:class_export_destroy()) destroying export ffff8cabf54e1800/OSS_uuid for OSS 00000020:01000000:1.0:1788529938.445958:0:13246:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788529938.446146:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cabf206ac00:6689] 2 exiting: rc = 0 00000100:00100000:1.0:1788529938.446226:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cabf206a200:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1788529938.446273:0:12086:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cabd5dce000:12086] 3 exiting: rc = 0 00000100:00080000:0.0:1788529938.446393:0:5825:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788529938.451958:0:12087:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8cabfc8b3600:12087] 4 exiting: rc = 0 00000100:00100000:0.0:1788529938.462099:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cabf206be00:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1788529938.462358:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462369:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462376:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462384:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462389:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462393:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462398:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462403:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462421:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462428:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462432:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462437:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462442:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462455:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462462:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462467:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462471:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462476:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462481:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462486:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462490:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462495:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462501:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462507:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462512:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462534:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462539:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462544:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462550:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462555:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462560:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462565:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462570:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462574:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462579:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462584:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462589:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462593:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462598:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462603:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462607:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462612:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462616:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462621:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462626:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462631:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462636:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462641:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462646:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462651:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462655:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462659:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462664:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462668:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462673:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462678:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462682:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462687:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462691:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462697:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462711:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462716:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462722:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.462727:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.463784:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cabf206a600:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788529938.464104:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cabf206ae00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1788529938.468223:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468234:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468240:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468245:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468250:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468255:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468260:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468264:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468269:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468274:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468279:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468284:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468289:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468294:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468299:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468304:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468309:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468314:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468318:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468323:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468328:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468333:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468338:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468342:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468348:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468352:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468380:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468387:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468393:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468398:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468413:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468434:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468439:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468444:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468459:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468464:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468468:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468473:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468478:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468484:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468489:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468494:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468501:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468506:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468511:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468516:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468521:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468526:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468531:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468537:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468542:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468547:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468552:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468557:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468562:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468567:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468572:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468577:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468582:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468588:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468594:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468599:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468605:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.468610:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.480708:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cabc3411a00:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1788529938.484098:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cabc7535600:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788529938.485348:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cabc8d4b400:6694] 2 exiting: rc = 0 00000100:00100000:1.0:1788529938.485654:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485663:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485687:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485693:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485699:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485713:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485720:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485725:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485730:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485736:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485742:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485747:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485752:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485757:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485763:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485769:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485773:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485778:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485784:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485803:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485809:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485814:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485831:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485838:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485844:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485863:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485869:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485874:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485879:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485885:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485890:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.485926:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486110:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486118:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486124:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486130:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486135:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486147:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486154:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486160:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486165:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486170:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486175:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486182:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486187:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486192:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486212:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486219:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486225:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486231:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486237:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486242:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486247:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486252:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486267:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486275:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486280:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486286:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486291:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486296:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486302:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486308:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486313:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788529938.486320:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.509107:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cabfcc99600:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1788529938.509359:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cabc3410e00:6696] 1 exiting: rc = 0 00000100:00100000:2.0:1788529938.511282:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511291:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511297:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511302:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511307:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511312:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511317:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511322:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511327:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511333:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511339:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511344:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511364:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511369:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511374:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511380:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511385:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511389:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511394:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511399:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511404:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511411:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511416:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511421:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511425:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511430:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511435:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511441:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511446:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511451:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511456:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511462:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511467:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511473:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511478:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511483:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511489:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511494:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511499:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511504:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511510:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511516:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511522:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511527:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511532:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511537:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511542:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511555:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511560:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511564:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511568:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511573:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511578:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511582:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511587:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511592:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511597:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511603:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511607:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511612:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511617:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511623:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511628:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.511642:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788529938.513147:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cabfcc89800:6697] 0 exiting: rc = 1 00000100:00100000:1.0:1788529938.515259:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cabfcca3800:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1788529938.516305:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516314:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516321:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516341:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516348:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516354:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516360:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516366:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516372:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516379:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516386:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516392:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516399:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516405:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516412:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516435:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516442:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516448:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516466:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516472:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516478:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516484:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516490:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516496:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516502:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516508:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516514:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516534:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516541:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516546:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516552:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516558:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516564:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516570:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516577:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516583:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516590:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516595:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516601:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516623:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516630:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516637:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516644:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516651:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516657:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516664:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516671:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516680:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516686:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516691:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516702:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516726:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516734:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516747:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516754:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516761:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516767:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516773:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516780:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516797:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516804:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516810:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516816:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788529938.516823:0:13246:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788529938.561809:0:13246:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788529960.495843:0:13861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788529970.960616:0:14321:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788529970.960623:0:14321:0:(obd_mount.c:928:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788529970.960737:0:14321:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cabf54e5800 00000020:01000004:2.0:1788529970.960755:0:14321:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788529970.960762:0:14321:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788529970.961580:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cabc2e90000) 00000020:00000080:2.0:1788529970.961596:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788529971.007330:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788529971.012697:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788529971.015401:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 437: rc = 0 00100000:10000000:2.0:1788529971.015488:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 437: rc = 0 00100000:10000000:2.0:1788529971.015565:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 437: rc = 0 00100000:10000000:2.0:1788529971.015647:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 437: rc = 0 00100000:10000000:2.0:1788529971.016606:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788529971.016678:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 437: rc = 0 00100000:10000000:2.0:1788529971.016796:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 437: rc = 0 00100000:10000000:2.0:1788529971.017543:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 439: rc = 0 00100000:10000000:2.0:1788529971.019158:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 584: rc = 0 00100000:10000000:2.0:1788529971.019278:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 584: rc = 0 00100000:10000000:2.0:1788529971.019669:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 585: rc = 0 00100000:10000000:2.0:1788529971.021458:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.022922:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.023322:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.023578:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 585: rc = 0 00100000:10000000:2.0:1788529971.025170:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 585: rc = 0 00100000:10000000:2.0:1788529971.025448:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 585: rc = 0 00100000:10000000:2.0:1788529971.025699:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.029481:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 585: rc = 0 00100000:10000000:2.0:1788529971.029752:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.032469:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 585: rc = 0 00100000:10000000:2.0:1788529971.032735:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 585: rc = 0 00100000:10000000:2.0:1788529971.034573:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 304: rc = 0 00100000:10000000:2.0:1788529971.034829:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 304: rc = 0 00100000:10000000:2.0:1788529971.036352:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 304: rc = 0 00100000:10000000:2.0:1788529971.036600:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 304: rc = 0 00100000:10000000:2.0:1788529971.038160:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 304: rc = 0 00100000:10000000:2.0:1788529971.038453:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 304: rc = 0 00100000:10000000:2.0:1788529971.038700:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 304: rc = 0 00100000:10000000:2.0:1788529971.040369:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 304: rc = 0 00100000:10000000:2.0:1788529971.040659:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 304: rc = 0 00100000:10000000:2.0:1788529971.042366:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 304: rc = 0 00100000:10000000:2.0:1788529971.042638:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 304: rc = 0 00100000:10000000:2.0:1788529971.044280:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 304: rc = 0 00100000:10000000:2.0:1788529971.044577:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 304: rc = 0 00100000:10000000:2.0:1788529971.046123:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 304: rc = 0 00100000:10000000:2.0:1788529971.046401:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 304: rc = 0 00100000:10000000:2.0:1788529971.046640:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 304: rc = 0 00100000:10000000:3.0:1788529971.048279:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 304: rc = 0 00100000:10000000:3.0:1788529971.048561:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 304: rc = 0 00100000:10000000:3.0:1788529971.048816:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 304: rc = 0 00100000:10000000:3.0:1788529971.050766:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 304: rc = 0 00100000:10000000:3.0:1788529971.052385:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 304: rc = 0 00100000:10000000:3.0:1788529971.052649:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 304: rc = 0 00100000:10000000:3.0:1788529971.054058:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 304: rc = 0 00100000:10000000:3.0:1788529971.054381:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 304: rc = 0 00100000:10000000:3.0:1788529971.054679:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 304: rc = 0 00100000:10000000:3.0:1788529971.056304:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 304: rc = 0 00100000:10000000:3.0:1788529971.056573:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 304: rc = 0 00100000:10000000:3.0:1788529971.056826:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 304: rc = 0 00100000:10000000:3.0:1788529971.058612:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 304: rc = 0 00100000:10000000:3.0:1788529971.060270:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 304: rc = 0 00100000:10000000:3.0:1788529971.060547:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 304: rc = 0 00100000:10000000:3.0:1788529971.060796:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 304: rc = 0 00100000:10000000:3.0:1788529971.066616:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 646: rc = 0 00100000:10000000:3.0:1788529971.069206:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788529971.070299:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 506: rc = 0 00100000:10000000:3.0:1788529971.070506:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788529971.070576:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 506: rc = 0 00100000:10000000:3.0:1788529971.070743:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788529971.070808:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 506: rc = 0 00100000:10000000:0.0:1788529971.085516:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788529971.085694:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 507: rc = 0 00100000:10000000:1.0:1788529971.093236:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788529971.093339:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 507: rc = 0 00100000:10000000:1.0:1788529971.093565:0:14321:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788529971.093638:0:14321:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 507: rc = 0 00000020:00000080:1.0:1788529971.095250:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788529971.095259:0:14321:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788529971.095277:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18bfc2 00000020:01000004:1.0:1788529971.095286:0:14321:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788529971.095291:0:14321:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788529971.095296:0:14321:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8cabf54e5800 from MGS 00000020:01000004:1.0:1788529971.095300:0:14321:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788529971.095311:0:14321:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cabfce33310) 00000020:00000080:1.0:1788529971.095321:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788529971.095370:0:14321:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabf54e5800 from MGS, refs=2 00080000:01000000:1.0:1788529971.095375:0:14321:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788529971.095384:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18bfd0 00000100:00100000:1.0:1788529971.095489:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788529971.095634:0:14321:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788529971.095640:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788529971.099971:0:14321:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788529971.099982:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788529971.100562:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529971.100727:0:14321:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788529971.100731:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788529971.101441:0:14321:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788529971.101447:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788529971.101542:0:14321:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788529971.101546:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788529971.103723:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529971.103728:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529971.103730:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529971.112604:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529971.112612:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529971.112614:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529971.117658:0:14321:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788529971.126439:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788529971.141132:0:14321:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788529971.141151:0:14321:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788529971.141154:0:14321:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788529971.146042:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788529971.146267:0:14321:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788529971.146394:0:14321:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788529971.148153:0:14321:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788529971.148460:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529971.148634:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788529971.148640:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788529971.163116:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788529971.163137:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788529971.174019:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788529971.176085:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788529971.181538:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788529971.181563:0:14321:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:3.0:1788529971.181565:0:14321:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788529971.181596:0:14321:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:3.0:1788529971.181607:0:14321:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (ffff8caac4a3b310) 00000020:00000080:3.0:1788529971.181622:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788529971.181699:0:14321:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabf60f7000@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1788529971.183226:0:14321:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:3.0:1788529971.183237:0:14321:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788529971.186038:0:14336:0:(mgc_request.c:893:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788529971.186143:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid 686d56f3-22b3-4cb4-96c8-2243e37ce242) 00000020:00000080:2.0:1788529971.186167:0:14321:0:(genops.c:1385:class_connect()) connect: client 686d56f3-22b3-4cb4-96c8-2243e37ce242, cookie 0xaa46022e3f18bfde 00000100:00080000:2.0:1788529971.186180:0:14321:0:(import.c:545:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788529971.186187:0:14321:0:(import.c:665:import_select_connection()) MGC192.168.201.152@tcp: import ffff8cabf60f7000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529971.186235:0:14321:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc254e00 x1875409185636736/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788529971.186262:0:14321:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 686d56f3-22b3-4cb4-96c8-2243e37ce242->MGS 00000020:01000004:2.0:1788529971.186291:0:14321:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788529971.186297:0:14321:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788529971.186312:0:14321:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cabc2e94c98) 00000020:00000080:2.0:1788529971.186322:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1788529971.186541:0:14335:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788529971.187882:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:686d56f3-22b3-4cb4-96c8-2243e37ce242:3299:1875409185636736:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788529971.187998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.188138:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636736 00000100:00100000:3.0:1788529971.188147:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636736 00000100:00100000:3.0:1788529971.188194:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788529971.188210:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875409185636736:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788529971.188252:0:14331:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 686d56f3-22b3-4cb4-96c8-2243e37ce242@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1788529971.188289:0:14331:0:(genops.c:1385:class_connect()) connect: client 686d56f3-22b3-4cb4-96c8-2243e37ce242, cookie 0xaa46022e3f18bfec 00000100:00080000:3.0:1788529971.188467:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8cabf60f1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529971.188524:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:3299:x1875409185636736:12345-0@lo:250:mount.lustre.0 Request processed in 320us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.188531:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788529971.188573:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788529971.188603:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1788529971.188611:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788529971.188621:0:3299:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788529971.188624:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf60f7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788529971.188627:0:3299:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788529971.188635:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788529971.188640:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:686d56f3-22b3-4cb4-96c8-2243e37ce242:3299:1875409185636736:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788529971.220386:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.220576:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788529971.220590:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788529971.237766:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788529971.237792:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788529971.238485:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788529971.238492:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788529971.239192:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.239402:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788529971.239407:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788529971.240324:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788529971.240333:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788529971.291715:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.292068:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788529971.292075:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788529971.293043:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788529971.293052:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788529971.293549:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.293855:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788529971.293861:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788529971.294494:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788529971.294502:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788529971.295087:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.295245:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788529971.295251:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788529971.295737:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788529971.295744:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788529971.296312:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788529971.296456:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788529971.296460:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788529971.297169:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788529971.297178:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788529971.311530:0:14321:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529971.311723:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788529971.311730:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788529971.313117:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788529971.313127:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788529971.313764:0:14321:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788529971.313778:0:14321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788529971.314718:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788529971.314760:0:14321:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788529971.314765:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788529971.314767:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788529971.314768:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529971.314769:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529971.314771:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529971.314772:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529971.314774:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788529971.314775:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788529971.314777:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529971.314778:0:14321:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788529971.314783:0:14321:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788529971.314785:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788529971.314787:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788529971.314788:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529971.314789:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529971.314790:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529971.314791:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529971.314792:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788529971.314793:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788529971.314794:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529971.314795:0:14321:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788529971.314833:0:14321:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788529971.314854:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185636864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788529971.314956:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529971.315001:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc11cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788529971.315077:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636864 00000100:00100000:1.0:1788529971.315086:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636864 00000100:00100000:1.0:1788529971.315140:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529971.315151:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:14321:x1875409185636864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788529971.315198:0:14334:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788529971.315201:0:14334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788529971.315204:0:14334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788529971.315587:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788529971.316000:0:14334:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788529971.317068:0:14356:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788529971.317079:0:14356:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788529971.317082:0:14356:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788529971.317119:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788529971.317427:0:14334:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788529971.317439:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788529971.326396:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:14321:x1875409185636864:12345-0@lo:253:mount.lustre.0 Request processed in 11228us (11420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.326416:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788529971.326614:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185636864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788529971.326640:0:14321:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788529971.326643:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788529971.326645:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788529971.326646:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529971.326648:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529971.326649:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529971.326650:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529971.326657:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788529971.326659:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788529971.326660:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529971.326661:0:14321:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788529971.326679:0:14321:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8cabf54e5800 from lustre-MDT0000 10000000:01000000:2.0:1788529971.326702:0:14321:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788529971.326705:0:14321:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788529971.326709:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cabf54e5800 10000000:01000000:2.0:1788529971.326714:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788529971.326730:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabf54e5800 from 1 10000000:01000000:2.0:1788529971.326734:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788529971.326777:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.326788:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.326797:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529971.326815:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185636992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788529971.327083:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529971.327141:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5004180 going to sleep for 11 seconds 00000100:00100000:1.0:1788529971.327181:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185636992 00000100:00100000:1.0:1788529971.327187:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185636992 00000100:00100000:1.0:1788529971.327260:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788529971.327270:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:14321:x1875409185636992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529971.327281:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529971.327295:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48000/0xaa46022e3f18bffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18bff3 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.327317:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48000/0xaa46022e3f18bffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18bff3 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.327328:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48000/0xaa46022e3f18bffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18bff3 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.327337:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48000, rc 0) 00000100:00100000:1.0:1788529971.327442:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+6:14321:x1875409185636992:12345-0@lo:101:mount.lustre.0 Request processed in 173us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529971.327448:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529971.327542:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185636992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.327555:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18bffa expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.327563:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18bffa expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.327601:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.327625:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.327735:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.327764:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637120 00000100:00100000:2.0:1788529971.327768:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637120 00000100:00100000:2.0:1788529971.327787:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529971.327792:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+6:14321:x1875409185637120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788529971.328027:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+6:14321:x1875409185637120:12345-0@lo:501:mount.lustre.0 Request processed in 233us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788529971.328034:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788529971.328106:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637120:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788529971.328121:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529971.328138:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18bffa expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328147:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100800/0xaa46022e3f18bff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18bffa expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.328155:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8cabf54e5800 10000000:01000000:3.0:1788529971.328160:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788529971.328175:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8cabf54e5800 10000000:01000000:3.0:1788529971.328184:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788529971.328194:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff8cabf54e5800 from 1 10000000:01000000:3.0:1788529971.328196:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788529971.328226:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328234:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328242:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.328253:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529971.328276:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.328294:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.328456:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637248 00000100:00100000:0.0:1788529971.328460:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637248 00000100:00100000:0.0:1788529971.328545:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788529971.328554:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+6:14321:x1875409185637248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788529971.328562:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529971.328574:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabfc242a00/0xaa46022e3f18c008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c001 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.328589:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabfc242a00/0xaa46022e3f18c008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c001 expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.328598:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabfc242a00/0xaa46022e3f18c008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c001 expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.328605:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242a00, rc 0) 00000100:00100000:0.0:1788529971.328641:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+7:14321:x1875409185637248:12345-0@lo:101:mount.lustre.0 Request processed in 88us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.328646:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788529971.328714:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.328724:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c008 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328732:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c008 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.328744:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788529971.328748:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c008 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328755:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff36200/0xaa46022e3f18c001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c008 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.328760:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788529971.328769:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529971.328785:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8cabf54e5800 10000000:01000000:3.0:1788529971.328788:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788529971.328797:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788529971.328799:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788529971.328812:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328819:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.328836:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.328848:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529971.328871:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.328889:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.329064:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637376 00000100:00100000:2.0:1788529971.329075:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637376 00000100:00100000:2.0:1788529971.329091:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788529971.329097:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+7:14321:x1875409185637376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788529971.329103:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788529971.329111:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100c00/0xaa46022e3f18c016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c00f expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.329124:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100c00/0xaa46022e3f18c016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c00f expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.329132:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100c00/0xaa46022e3f18c016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c00f expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.329139:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100c00, rc 0) 00000100:00100000:2.0:1788529971.329171:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+8:14321:x1875409185637376:12345-0@lo:101:mount.lustre.0 Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.329177:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788529971.329252:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.329262:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c016 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.329269:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c016 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.329296:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.329319:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.329349:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.329468:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637504 00000100:00100000:0.0:1788529971.329474:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637504 00000100:00100000:0.0:1788529971.329567:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788529971.329574:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+8:14321:x1875409185637504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788529971.329969:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14321:x1875409185637504:12345-0@lo:501:mount.lustre.0 Request processed in 395us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.329976:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788529971.330210:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.330264:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529971.330303:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.330335:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.330447:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637632 00000100:00100000:0.0:1788529971.330451:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637632 00000100:00100000:0.0:1788529971.330485:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788529971.330492:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14321:x1875409185637632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788529971.330777:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14321:x1875409185637632:12345-0@lo:503:mount.lustre.0 Request processed in 285us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.330785:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788529971.331024:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185637632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529971.331528:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14357:1875409185637760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.331569:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.331603:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.331660:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185637760 00000100:00100000:0.0:1788529971.331665:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185637760 00000100:00100000:0.0:1788529971.331701:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788529971.331708:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14357:x1875409185637760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529971.332311:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14357:x1875409185637760:12345-0@lo:502:llog_process_th.0 Request processed in 600us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.332320:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788529971.332457:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14357:1875409185637760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788529971.332483:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788529971.332493:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529971.332496:0:14357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788529971.332500:0:14357:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788529971.332503:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788529971.332517:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8caac4a3e620) 00000020:00000080:3.0:1788529971.332537:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788529971.332542:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788529971.332597:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788529971.332603:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18c024 00000020:00000080:3.0:1788529971.332795:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788529971.332800:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788529971.332803:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529971.332805:0:14357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788529971.332807:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788529971.332810:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788529971.332812:0:14357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788529971.332814:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788529971.332821:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8caac4a38000) 00000020:00000080:3.0:1788529971.333088:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788529971.333103:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788529971.333105:0:14357:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788529971.333108:0:14357:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788529971.333113:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788529971.333156:0:14357:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabf54e5800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788529971.333169:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8caac4a3cc98) 00000020:00000080:3.0:1788529971.333177:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788529971.333239:0:14357:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788529971.333245:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18c039 00000020:00000080:3.0:1788529971.333341:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788529971.333347:0:14357:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788529971.333420:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa46022e3f18c040 00080000:01000000:3.0:1788529971.333428:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788529971.333432:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18c047 00010000:00010000:2.0:1788529971.411151:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788529971.411727:0:14357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788529971.412077:0:14357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788529971.412839:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cabc2e96620) 00000020:00000080:2.0:1788529971.412857:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788529971.412984:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788529971.412992:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18c055 00000020:00000080:2.0:1788529971.413517:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788529971.424582:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa46022e3f18c05c 00000020:00000080:2.0:1788529971.426592:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788529971.426606:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529971.426614:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529971.426623:0:14357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788529971.426628:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529971.426633:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529971.426635:0:14357:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788529971.426639:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788529971.426681:0:14357:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788529971.426697:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529971.426701:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529971.426702:0:14357:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788529971.426704:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788529971.426706:0:14357:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788529971.426708:0:14357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788529971.426709:0:14357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788529971.426711:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788529971.426713:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529971.426714:0:14357:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788529971.426716:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788529971.426731:0:14357:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788529971.426736:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529971.426737:0:14357:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788529971.426740:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788529971.426745:0:14357:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:2.0:1788529971.426772:0:14357:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788529971.426775:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788529971.426791:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cabc2e91988) 00000020:00000080:2.0:1788529971.426808:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788529971.426813:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788529971.427466:0:14357:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788529971.427473:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788529971.427480:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18c06a 00010000:00080000:2.0:1788529971.427514:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabc35b7000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1788529971.428009:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788529971.429244:0:14357:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788529971.430100:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788529971.432676:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529971.432766:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788529971.432845:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788529971.434601:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788529971.434607:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788529971.447247:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788529971.447264:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788529971.447313:0:14357:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788529971.447334:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18c071 00000100:00080000:0.0:1788529971.447345:0:14357:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788529971.447351:0:14357:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cabc35b7000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529971.447389:0:14357:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8caac779c000 x1875409185637888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788529971.447410:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788529971.447472:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529971.447476:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.447478:0:14357:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788529971.447480:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788529971.447483:0:14357:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788529971.447485:0:14357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788529971.447486:0:14357:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788529971.447494:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788529971.447496:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.447498:0:14357:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788529971.447500:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788529971.447504:0:14357:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788529971.447507:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.447508:0:14357:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788529971.447511:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788529971.447515:0:14357:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1788529971.447536:0:14357:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788529971.447538:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788529971.447549:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cabc3ecb310) 00000020:00000080:0.0:1788529971.447560:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788529971.447563:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788529971.447614:0:14357:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788529971.447631:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788529971.447636:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa46022e3f18c07f 00010000:00080000:0.0:1788529971.447673:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabf5662000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1788529971.447864:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788529971.448079:0:14357:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788529971.448105:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788529971.448643:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529971.448728:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788529971.448798:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1788529971.449024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185637888:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788529971.449079:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409185637888 offset 0 length 520: 4 00000040:00080000:1.0:1788529971.450458:0:14363:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788529971.450464:0:14363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788529971.451358:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788529971.451370:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788529971.451403:0:14357:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788529971.451421:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18c086 00000100:00080000:0.0:1788529971.451431:0:14357:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788529971.451437:0:14357:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788529971.451487:0:14357:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8caac779e300 x1875409185638016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788529971.451561:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185638016:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788529971.451629:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409185638016 offset 0 length 520: 4 00000100:00080000:0.0:1788529971.452007:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788529971.452154:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529971.452159:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.452162:0:14357:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788529971.452165:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529971.452169:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.452171:0:14357:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788529971.452174:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788529971.452176:0:14357:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788529971.452178:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529971.452180:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.452182:0:14357:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788529971.452184:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788529971.452187:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.452188:0:14357:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788529971.452192:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788529971.452234:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14357:1875409185638144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529971.452285:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529971.452318:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.452364:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638144 00000100:00100000:3.0:1788529971.452371:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638144 00000100:00100000:3.0:1788529971.452421:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788529971.452429:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14357:x1875409185638144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.452653:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14357:x1875409185638144:12345-0@lo:502:llog_process_th.0 Request processed in 224us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.452661:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788529971.452747:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14357:1875409185638144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788529971.452775:0:14357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788529971.452779:0:14357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788529971.452781:0:14357:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788529971.452785:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788529971.453025:0:14321:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788529971.453034:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788529971.453055:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c016 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.453065:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff37a00/0xaa46022e3f18c00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c016 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.453073:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf54e5800 from 1 10000000:01000000:3.0:1788529971.453076:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788529971.453109:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.453117:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.453126:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.453140:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529971.453170:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.453197:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.453257:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638272 00000100:00100000:0.0:1788529971.453262:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638272 00000100:00100000:0.0:1788529971.453295:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788529971.453303:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+9:14321:x1875409185638272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788529971.453312:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529971.453331:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c08d expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.453354:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.453364:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.453372:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242800, rc 0) 00000100:00100000:0.0:1788529971.453401:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+10:14321:x1875409185638272:12345-0@lo:101:mount.lustre.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.453408:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788529971.453471:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.453483:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.453492:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.454042:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638400:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788529971.454078:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.454098:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.454117:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638400 00000100:00100000:3.0:1788529971.454121:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638400 00000100:00100000:3.0:1788529971.454145:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529971.454151:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+10:14321:x1875409185638400:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788529971.454165:0:14331:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788529971.454171:0:14331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788529971.454281:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+10:14321:x1875409185638400:12345-0@lo:256:mount.lustre.0 Request processed in 129us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.454288:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788529971.454321:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638400:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788529971.454883:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788529971.454913:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.454924:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.454932:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf54e5800 from 1 10000000:01000000:3.0:1788529971.454935:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529971.454958:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.454965:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.454973:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.454989:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529971.455021:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.455040:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.455058:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638528 00000100:00100000:3.0:1788529971.455063:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638528 00000100:00100000:3.0:1788529971.455085:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529971.455092:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+10:14321:x1875409185638528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.455108:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529971.455122:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c09b expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.455141:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.455150:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.455158:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabeff37200, rc 0) 00000100:00100000:3.0:1788529971.455187:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185638528:12345-0@lo:101:mount.lustre.0 Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.455194:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788529971.455240:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.455251:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.455259:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.455289:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.455310:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.455323:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf55ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.455335:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638656 00000100:00100000:3.0:1788529971.455339:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638656 00000100:00100000:3.0:1788529971.455360:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529971.455365:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185638656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.455725:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185638656:12345-0@lo:501:mount.lustre.0 Request processed in 358us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.455733:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788529971.455766:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.455790:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529971.455827:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.455840:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441600 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.455853:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638784 00000100:00100000:3.0:1788529971.455857:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638784 00000100:00100000:3.0:1788529971.455874:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529971.455880:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185638784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788529971.457273:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185638784:12345-0@lo:503:mount.lustre.0 Request processed in 1387us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.457284:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788529971.457369:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185638784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788529971.457732:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14365:1875409185638912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529971.457775:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529971.457862:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788529971.461356:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185638912 00000100:00100000:0.0:1788529971.461373:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185638912 00000100:00100000:0.0:1788529971.461443:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788529971.461453:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14365:x1875409185638912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788529971.461782:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14365:x1875409185638912:12345-0@lo:502:llog_process_th.0 Request processed in 329us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.461791:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788529971.462114:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14365:1875409185638912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788529971.462159:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529971.462168:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.462170:0:14365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788529971.462178:0:14365:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabf54e5800 00000020:00000080:1.0:1788529971.462181:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529971.462188:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529971.462190:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.462191:0:14365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788529971.462194:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529971.462196:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.462197:0:14365:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788529971.462200:0:14365:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabf54e5800 00000020:00000080:1.0:1788529971.462202:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529971.462263:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529971.462266:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.462268:0:14365:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788529971.462270:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529971.462272:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.462273:0:14365:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788529971.462276:0:14365:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cabf54e5800 00000020:00000080:1.0:1788529971.462278:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788529971.462325:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14365:1875409185639040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788529971.462370:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529971.462407:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77780 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.462458:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639040 00000100:00100000:2.0:1788529971.462463:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639040 00000100:00100000:2.0:1788529971.462494:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788529971.462501:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14365:x1875409185639040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788529971.462656:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14365:x1875409185639040:12345-0@lo:502:llog_process_th.0 Request processed in 147us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.462663:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788529971.464913:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14365:1875409185639040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788529971.464964:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529971.464973:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529971.464975:0:14365:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788529971.464980:0:14365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788529971.465181:0:14321:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788529971.465192:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529971.465225:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.465235:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529971.465286:0:14321:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788529971.465289:0:14321:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8cabf54e5800 10000000:01000000:3.0:1788529971.465292:0:14321:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8cabf54e5800 10000000:01000000:3.0:1788529971.465297:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529971.465314:0:14321:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabf54e5800 from 1 10000000:01000000:3.0:1788529971.465317:0:14321:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788529971.465358:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.465367:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.465378:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.465398:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529971.465455:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.465501:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529971.465808:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639168 00000100:00100000:1.0:1788529971.465822:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639168 00000100:00100000:1.0:1788529971.465872:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788529971.465890:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185639168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529971.465928:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529971.465942:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48400/0xaa46022e3f18c0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c0a9 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.465966:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48400/0xaa46022e3f18c0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c0a9 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.465976:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48400/0xaa46022e3f18c0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c0a9 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.465984:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48400, rc 0) 00000100:00100000:1.0:1788529971.466023:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639168:12345-0@lo:101:mount.lustre.0 Request processed in 143us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529971.466030:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788529971.466768:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529971.466788:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0b0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.466798:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c0b0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.466843:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.466879:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.466949:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.467014:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639296 00000100:00100000:2.0:1788529971.467020:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639296 00000100:00100000:2.0:1788529971.467064:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788529971.467073:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788529971.467343:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639296:12345-0@lo:501:mount.lustre.0 Request processed in 270us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.467350:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788529971.467490:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529971.467522:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529971.467561:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.467591:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.467637:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639424 00000100:00100000:2.0:1788529971.467641:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639424 00000100:00100000:2.0:1788529971.467682:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788529971.467689:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788529971.467827:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639424:12345-0@lo:503:mount.lustre.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.467835:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788529971.468078:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529971.470948:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14367:1875409185639552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.471031:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.471068:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639552 00000100:00100000:3.0:1788529971.471075:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639552 00000100:00100000:3.0:1788529971.471114:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788529971.471122:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14367:x1875409185639552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.471353:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14367:x1875409185639552:12345-0@lo:502:llog_process_th.0 Request processed in 230us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.471361:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788529971.471406:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.471425:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14367:1875409185639552:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788529971.471481:0:14367:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788529971.471496:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8caac4a39988) 00000020:00000080:3.0:1788529971.471517:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788529971.471591:0:14367:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabf54e5800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788529971.471596:0:14367:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabf54e5800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788529971.471599:0:14367:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabf54e5800 4 00010000:00080000:3.0:1788529971.471634:0:14367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabc3e14000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1788529971.480071:0:14367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788529971.482102:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788529971.482143:0:14367:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788529971.482156:0:14367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa46022e3f18c0be 00000100:00080000:3.0:1788529971.482167:0:14367:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788529971.482173:0:14367:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cabc3e14000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788529971.482208:0:14367:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc132300 x1875409185639680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788529971.482276:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185639680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788529971.482343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.482424:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639680 00000100:00100000:3.0:1788529971.482432:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639680 00000100:00100000:3.0:1788529971.482460:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788529971.482467:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185639680:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788529971.482515:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185639680:12345-0@lo:38:llog_process_th.0 Request processed in 46us (171us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788529971.482522:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788529971.482555:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788529971.482562:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788529971.482575:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788529971.482578:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185639680:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788529971.482608:0:14367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788529971.495742:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14367:1875409185639808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.496467:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.496507:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3441e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788529971.496531:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639808 00000100:00100000:3.0:1788529971.496539:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639808 00000100:00100000:3.0:1788529971.496650:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788529971.496661:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14367:x1875409185639808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788529971.499734:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14367:x1875409185639808:12345-0@lo:502:llog_process_th.0 Request processed in 3065us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529971.499749:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788529971.499842:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:686d56f3-22b3-4cb4-96c8-2243e37ce242:14367:1875409185639808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788529971.500209:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788529971.500676:0:14321:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788529971.500686:0:14321:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788529971.500702:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0b0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529971.500712:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff36a00/0xaa46022e3f18c0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0b0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788529971.500767:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788529971.500769:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529971.500770:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529971.500771:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529971.500772:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529971.500773:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529971.500774:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529971.500776:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529971.500778:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529971.500779:0:14321:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788529971.500782:0:14321:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788529971.500785:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788529971.500786:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529971.500787:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529971.500788:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529971.500789:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529971.500790:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529971.500791:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529971.500791:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529971.500792:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529971.500793:0:14321:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788529971.500813:0:14321:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788529971.500829:0:14321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788529971.502036:0:14321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529971.502092:0:14321:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db600 going to sleep for 11 seconds 00000100:00100000:2.0:1788529971.502254:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185639936 00000100:00100000:2.0:1788529971.502263:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185639936 00000100:00100000:2.0:1788529971.502390:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788529971.502400:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14321:x1875409185639936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788529971.502429:0:14331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788529971.502445:0:14331:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788529971.618518:0:14331:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788529971.618627:0:14331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788529971.620230:0:14355:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788529971.620237:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788529971.620320:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.620339:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.620348:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.620390:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.620427:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 12 pid: 14334 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529971.620443:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185640064:0@lo:104: 00000100:00100000:1.0:1788529971.620509:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529971.620605:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c77840 going to sleep for 11 seconds 00000100:00100000:1.0:1788529971.624201:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640064 00000100:00100000:1.0:1788529971.624223:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640064 00000100:00100000:1.0:1788529971.624294:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529971.624305:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185640064:12345-0@lo:104: 00010000:00010000:1.0:1788529971.624324:0:14322:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529971.624430:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185640064:0@lo:104: 00010000:00010000:1.0:1788529971.624452:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624473:0:14322:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788529971.624480:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185640064:12345-0@lo:104: Request processed in 177us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529971.624487:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788529971.624505:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529971.624510:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624518:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36c00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788529971.624521:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624545:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788529971.624553:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529971.624559:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788529971.624595:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624611:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788529971.624631:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624639:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c094 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529971.624656:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529971.624658:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529971.624660:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529971.624690:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185640192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788529971.624728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529971.625641:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640192 00000100:00100000:2.0:1788529971.625650:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640192 00010000:00010000:2.0:1788529971.625677:0:14324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 13 pid: 14334 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529971.625714:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788529971.625723:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:3301:x1875409185640192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788529971.625734:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788529971.625740:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 13 pid: 14334 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625754:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 13 pid: 14334 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625769:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabfc242800/0xaa46022e3f18c094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c08d expref: 13 pid: 14334 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625782:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625791:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788529971.625806:0:14324:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005568522s 00010000:00010000:2.0:1788529971.625811:0:14324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625836:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625844:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625851:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625858:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529971.625863:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.625871:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.626100:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529971.626112:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788529971.626226:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3301:x1875409185640192:12345-0@lo:103:ldlm_bl.0 Request processed in 503us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529971.626234:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788529971.626301:0:14355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.626311:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529971.626323:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c0c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529971.627262:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185640192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529971.636066:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14321:x1875409185639936:12345-0@lo:253:mount.lustre.0 Request processed in 133658us (134024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529971.636082:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788529971.636479:0:14321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:14321:1875409185639936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788529971.636495:0:14321:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788529971.636499:0:14321:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529971.636501:0:14321:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788529971.636502:0:14321:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529971.636504:0:14321:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529971.636505:0:14321:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529971.636506:0:14321:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529971.636508:0:14321:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788529971.636510:0:14321:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788529971.636512:0:14321:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529971.636513:0:14321:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788529971.636528:0:14321:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788529971.643652:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.643795:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529971.644236:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.644455:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529971.644722:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.645182:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529971.646084:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.646532:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529971.646798:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.647082:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529971.648077:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529971.648350:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788529971.681536:0:14321:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788529971.682158:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788529971.682566:0:14378:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788529971.682644:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788529971.686521:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788529971.686646:0:14321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788529971.688547:0:14321:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788529971.688565:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1788529971.689368:0:14377:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788529971.689373:0:14377:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1788529971.689976:0:14321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788529971.690671:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788529971.690745:0:14378:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788529971.690749:0:14378:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788529971.691877:0:14321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788529971.692762:0:14321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788529971.692807:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788529971.695571:0:14321:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788529971.705675:0:14321:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788529971.761537:0:14321:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788529971.761569:0:14321:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5a9c1caf9b8 00100000:10000000:2.0:1788529971.761577:0:14321:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788529971.763519:0:14321:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788529971.763539:0:14321:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788529972.173071:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529972.558600:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788529973.069107:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788529973.069115:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf54e5800 from 6 10000000:01000000:3.0:1788529973.069121:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788529973.069192:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529973.069205:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529973.069217:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529973.069256:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185640320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788529973.069534:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529973.069617:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc95dec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788529973.069680:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640320 00000100:00100000:0.0:1788529973.069687:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640320 00000100:00100000:0.0:1788529973.069743:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788529973.069753:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14336:x1875409185640320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788529973.069767:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529973.069781:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c0cc expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529973.069875:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529973.069886:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529973.069921:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243200, rc 0) 00000100:00100000:0.0:1788529973.069972:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185640320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529973.069978:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788529973.070105:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185640320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529973.070120:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529973.070129:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529973.070198:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185640448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788529973.070233:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529973.070271:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788529973.070431:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640448 00000100:00100000:0.0:1788529973.070436:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640448 00000100:00100000:0.0:1788529973.070470:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788529973.070477:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185640448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788529973.070491:0:14331:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788529973.070508:0:14331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788529973.070511:0:14331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788529973.070591:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185640448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529973.070598:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788529973.070672:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185640448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788529973.070723:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788529973.070729:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529973.071091:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529973.198316:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788529973.587123:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788529974.221080:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529975.245309:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529976.272249:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788529976.909840:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788529976.909848:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788529976.909851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788529976.909854:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788529976.909856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788529976.909860:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788529976.909864:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788529976.909877:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cabc3e14000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788529976.909920:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc130380 x1875409185640704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788529976.909961:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788529976.909974:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185640576:0@lo:400:kworker.0 00000100:00100000:3.0:1788529976.910048:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529976.910096:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640576 00000100:00100000:1.0:1788529976.910104:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640576 00000100:00100000:1.0:1788529976.910214:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788529976.910234:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3303:x1875409185640576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529976.910302:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3303:x1875409185640576:12345-0@lo:400:kworker.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529976.910309:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788529976.910520:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788529976.910573:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185640704:0@lo:38:kworker.0 00000100:00100000:0.0:1788529976.910605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529976.910656:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640704 00000100:00100000:3.0:1788529976.910660:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640704 00000100:00100000:3.0:1788529976.910688:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529976.910694:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875409185640704:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788529976.910718:0:14341:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1788529976.910757:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa46022e3f18c0da 00000004:00100000:3.0:1788529976.910777:0:14341:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788529976.911192:0:14341:0:(import.c:65:import_set_state_nolock()) ffff8cabd54c2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529976.911493:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875409185640704:12345-0@lo:38:kworker.0 Request processed in 797us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529976.911502:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788529976.911579:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cabfc130380 x1875409185640704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788529986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788529976.911594:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788529976.911601:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788529976.911605:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788529976.911607:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc3e14000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788529976.911612:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875409185640704:0@lo:38:kworker.0 00000001:02000400:3.0:1788529977.116097:0:14621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788529977.294219:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529978.317798:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529979.346943:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529980.365535:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788529981.006028:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788529971/real 1788529971] req@ffff8caac779e300 x1875409185638016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529981.006080:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8caac779e300 x1875409185638016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529981.006092:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788529971/real 1788529971] req@ffff8caac779c000 x1875409185637888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529981.006105:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8caac779c000 x1875409185637888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788529981.006129:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788529981.006167:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788529981.006172:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185638016:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788529981.006178:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788529981.006184:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788529981.006188:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185637888:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788529981.006333:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788529981.006338:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788529981.006340:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788529981.006346:0:12190:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:1.0:1788529981.006353:0:12190:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788529981.006363:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cabc35b7000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1788529981.006389:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfcb1b100 x1875409185640960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788529981.006405:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788529981.006415:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788529981.006417:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788529981.006421:0:12190:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:1.0:1788529981.006424:0:12190:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788529981.006427:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1788529981.006440:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfcb19880 x1875409185641088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788529981.006488:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185641216:0@lo:400:kworker.0 00000100:00100000:1.0:1788529981.006570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529981.006666:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641216 00000100:00100000:1.0:1788529981.006674:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641216 00000100:00100000:1.0:1788529981.006728:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529981.006739:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185641216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529981.006796:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185641216:12345-0@lo:400:kworker.0 Request processed in 59us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529981.006804:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788529981.006848:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cabfcb1ad80 x1875409185641216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788529997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529981.006861:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185641216:0@lo:400:kworker.0 00000100:00100000:1.0:1788529981.006877:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185640960:0@lo:8:kworker.0 00000400:00000100:1.0:1788529981.006931:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409185640960 offset 0 length 520: 4 00000100:00100000:1.0:1788529981.006950:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185641088:0@lo:8:kworker.0 00000400:00000100:1.0:1788529981.006968:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409185641088 offset 0 length 520: 4 00000100:00100000:0.0:1788529981.007106:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788529981.007116:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185640832:0@lo:400:kworker.0 00000100:00100000:0.0:1788529981.007154:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529981.011842:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185640832 00000100:00100000:1.0:1788529981.011869:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185640832 00000100:00100000:1.0:1788529981.011953:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788529981.011967:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3302:x1875409185640832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529981.012100:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3302:x1875409185640832:12345-0@lo:400:kworker.0 Request processed in 136us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529981.012108:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788529981.012178:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185640832:0@lo:400:kworker.0 00000020:00000080:2.0:1788529981.030235:0:14772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7e0984f0 20000000:00000080:2.0:1788529981.030260:0:14772:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cabcf5cf800 uarg=0000000000000000 20000000:01000000:2.0:1788529981.030477:0:14772:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788529981.030487:0:14772:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788529981.030493:0:14772:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788529981.034034:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788529981.034318:0:14772:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788529981.049421:0:14772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788529981.054254:0:14772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529981.054280:0:14772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529981.054289:0:14772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529981.054350:0:14772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529981.054371:0:14772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 11 pid: 14331 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529981.054388:0:14772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14772:1875409185641344:0@lo:104: 00000100:00100000:1.0:1788529981.054461:0:14772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529981.054522:0:14772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788529981.054595:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641344 00000100:00100000:3.0:1788529981.054610:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641344 00000100:00100000:3.0:1788529981.054677:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529981.054687:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14772:x1875409185641344:12345-0@lo:104: 00010000:00010000:3.0:1788529981.054707:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529981.054811:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788529981.054817:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14772:x1875409185641344:12345-0@lo:104: Request processed in 132us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529981.054824:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788529981.054855:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529981.054865:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.054874:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff36800 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:0.0:1788529981.054879:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.054889:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788529981.054914:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529981.054920:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788529981.054960:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.054968:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788529981.055128:0:14772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14772:1875409185641344:0@lo:104: 00010000:00010000:2.0:1788529981.055161:0:14772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063155:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063175:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff36800/0xaa46022e3f18c09b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063211:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529981.063214:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529981.063218:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529981.063234:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788529981.063274:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185641472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788529981.063404:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529981.063642:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641472 00000100:00100000:0.0:1788529981.063655:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641472 00010000:00010000:0.0:1788529981.063713:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 12 pid: 14331 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529981.063752:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529981.063762:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3300:x1875409185641472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529981.063777:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529981.063783:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 12 pid: 14331 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063803:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 12 pid: 14331 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063822:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabeff37200/0xaa46022e3f18c0a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c09b expref: 12 pid: 14331 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063841:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063850:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063887:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063936:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063944:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063952:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063959:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529981.063963:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063971:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.063991:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529981.064002:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788529981.064061:0:14772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529981.064076:0:14772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529981.064099:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:3300:x1875409185641472:12345-0@lo:103:ldlm_bl.0 Request processed in 334us (690us total) trans 0 rc 0/0 00010000:00010000:2.0:1788529981.064111:0:14772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48c00/0xaa46022e3f18c0e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529981.064121:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788529981.064151:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185641472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788529981.389260:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529982.423425:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788529982.989713:0:14336:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788529982.989721:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf54e5800 from 10 10000000:01000000:3.0:1788529982.989726:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529982.989773:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529982.989786:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529982.989799:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529982.989827:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788529982.989933:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529982.989984:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc51dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529982.990182:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641600 00000100:00100000:1.0:1788529982.990191:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641600 00000100:00100000:1.0:1788529982.990267:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788529982.990277:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+11:14336:x1875409185641600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529982.990290:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529982.990305:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c0e8 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529982.990326:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529982.990336:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529982.990346:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49600, rc 0) 00000100:00100000:1.0:1788529982.990393:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185641600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529982.990400:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788529982.990692:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529982.990711:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529982.990719:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529982.990753:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529982.990774:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529982.990792:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc51dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788529982.991080:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641728 00000100:00100000:2.0:1788529982.991086:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641728 00000100:00100000:2.0:1788529982.991127:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788529982.991146:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185641728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788529982.991431:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185641728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529982.991438:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788529982.991487:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788529982.991519:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788529982.991556:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529982.991707:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc51dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529982.991760:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641856 00000100:00100000:1.0:1788529982.991765:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641856 00000100:00100000:1.0:1788529982.991798:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788529982.991804:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185641856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788529982.994448:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:14336:x1875409185641856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2634us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529982.994463:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788529982.995147:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185641856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788529982.997379:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788529982.998215:0:14336:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788529982.998230:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788529982.998753:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529982.998768:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529983.445076:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788529983.822243:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788529984.461193:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529985.485302:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788529986.126108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529986.126116:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788529986.126119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529986.126134:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788529986.126218:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185641984:0@lo:400:kworker.0 00000100:00100000:1.0:1788529986.126297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529986.126367:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529986.126382:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185642112:0@lo:400:kworker.0 00000100:00100000:1.0:1788529986.126414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529986.126450:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642112 00000100:00100000:1.0:1788529986.126459:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642112 00000100:00100000:1.0:1788529986.126519:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788529986.126528:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185642112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529986.126609:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185642112:12345-0@lo:400:kworker.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.126617:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788529986.126667:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8caac779c380 x1875409185642112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529986.126681:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185642112:0@lo:400:kworker.0 00000100:00100000:0.0:1788529986.127431:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185641984 00000100:00100000:0.0:1788529986.127438:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185641984 00000100:00100000:0.0:1788529986.127492:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788529986.127501:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3302:x1875409185641984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529986.127578:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:3302:x1875409185641984:12345-0@lo:400:kworker.0 Request processed in 66us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.127601:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788529986.128392:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185641984:0@lo:400:kworker.0 00010000:00010000:3.0:1788529986.530275:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788529986.641452:0:15020:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788529986.641456:0:15020:0:(obd_mount.c:928:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788529986.641588:0:15020:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cabc3e16800 00000020:01000004:3.0:1788529986.641616:0:15020:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788529986.641639:0:15020:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788529986.641666:0:15020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cabcf788000) 00000020:00000080:3.0:1788529986.641683:0:15020:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788529986.660834:0:15020:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788529986.661277:0:15020:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788529986.662390:0:15020:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788529986.662808:0:15020:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788529986.663240:0:15020:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788529986.663844:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 653: rc = 0 00100000:10000000:2.0:1788529986.664074:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 653: rc = 0 00100000:10000000:2.0:1788529986.664206:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 653: rc = 0 00100000:10000000:2.0:1788529986.665311:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 567: rc = 0 00100000:10000000:2.0:1788529986.666834:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 567: rc = 0 00100000:10000000:2.0:1788529986.667223:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 567: rc = 0 00100000:10000000:2.0:1788529986.667529:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 567: rc = 0 00100000:10000000:2.0:1788529986.667941:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 567: rc = 0 00100000:10000000:2.0:1788529986.668189:0:15020:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 567: rc = 0 00000020:00000080:2.0:1788529986.669440:0:15020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788529986.669452:0:15020:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788529986.669536:0:15020:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa46022e3f18c0fd 00000020:01000004:2.0:1788529986.669546:0:15020:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788529986.669698:0:15020:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788529986.669702:0:15020:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788529986.669709:0:15020:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788529986.669713:0:15020:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788529986.669726:0:15020:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cabc2e93310) 00000020:00000080:2.0:1788529986.669737:0:15020:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788529986.671061:0:15020:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529986.671235:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788529986.671258:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788529986.672184:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788529986.672192:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788529986.672557:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788529986.672685:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788529986.676157:0:15020:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529986.676353:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788529986.676359:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788529986.684829:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788529986.684845:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788529986.702986:0:15020:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529986.703225:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788529986.703232:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788529986.704702:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788529986.704713:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788529986.705714:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788529986.705723:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788529986.708137:0:15020:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788529986.708337:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788529986.708343:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788529986.709205:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788529986.709215:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788529986.744383:0:15020:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788529986.744759:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788529986.744767:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788529986.746038:0:15020:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788529986.746052:0:15020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788529986.746443:0:15020:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788529986.746554:0:15020:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788529986.746559:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788529986.746560:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529986.746562:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529986.746563:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529986.746564:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529986.746565:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529986.746567:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529986.746569:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529986.746570:0:15020:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529986.746574:0:15020:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788529986.746576:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788529986.746578:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529986.746579:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529986.746580:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529986.746582:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529986.746583:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529986.746584:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529986.746585:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529986.746586:0:15020:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788529986.746682:0:15020:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788529986.746704:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642240:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788529986.746773:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.746839:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd01d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.746935:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642240 00000100:00100000:1.0:1788529986.746954:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642240 00000100:00100000:1.0:1788529986.746999:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788529986.747009:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:15020:x1875409185642240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788529986.747041:0:14333:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788529986.747044:0:14333:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788529986.747048:0:14333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788529986.756524:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:15020:x1875409185642240:12345-0@lo:253:mount.lustre.0 Request processed in 9499us (9732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.756539:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788529986.756773:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642240:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788529986.756788:0:15020:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788529986.756792:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788529986.756794:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788529986.756795:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788529986.756796:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788529986.756798:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788529986.756799:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788529986.756801:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788529986.756802:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788529986.756804:0:15020:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788529986.756822:0:15020:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8cabc3e16800 from lustre-OST0000 10000000:01000000:3.0:1788529986.756858:0:15020:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788529986.756861:0:15020:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788529986.756867:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cabc3e16800 10000000:01000000:3.0:1788529986.756873:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529986.756887:0:15020:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788529986.761442:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788529986.775306:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788529986.775328:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8cabc3e16800 from 1 10000000:01000000:2.0:1788529986.775332:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788529986.775382:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.775394:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.775405:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529986.776237:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788529986.776322:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.776379:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788529986.776674:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642368 00000100:00100000:3.0:1788529986.776683:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642368 00000100:00100000:3.0:1788529986.776806:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788529986.776819:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+12:15020:x1875409185642368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529986.776838:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529986.776856:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabeff36800/0xaa46022e3f18c112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c10b expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.776882:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabeff36800/0xaa46022e3f18c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c10b expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.777227:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabeff36800/0xaa46022e3f18c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c10b expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.777237:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabeff36800, rc 0) 00000100:00100000:3.0:1788529986.777300:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642368:12345-0@lo:101:mount.lustre.0 Request processed in 484us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529986.777307:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788529986.777511:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788529986.777529:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c112 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.777539:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c112 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529986.778569:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788529986.778619:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.778660:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.779213:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642496 00000100:00100000:1.0:1788529986.779223:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642496 00000100:00100000:1.0:1788529986.779288:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788529986.779298:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788529986.779545:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642496:12345-0@lo:501:mount.lustre.0 Request processed in 247us (924us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529986.779553:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788529986.779711:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642496:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788529986.779743:0:15020:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788529986.784697:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529986.784833:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.784882:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd01d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.784990:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642624 00000100:00100000:1.0:1788529986.784999:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642624 00000100:00100000:1.0:1788529986.785097:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788529986.785108:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788529986.785362:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642624:12345-0@lo:501:mount.lustre.0 Request processed in 256us (529us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788529986.785370:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788529986.785449:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788529986.785592:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788529986.785613:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c112 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.785624:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100600/0xaa46022e3f18c10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c112 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529986.785635:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8cabc3e16800 10000000:01000000:3.0:1788529986.785641:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788529986.785661:0:15020:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788529986.786438:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788529986.786448:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788529986.786458:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8caac4a3b310 10000000:01000000:3.0:1788529986.786462:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788529986.786479:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log nodemap-ffff8caac4a3b310 from 1 10000000:01000000:3.0:1788529986.786482:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788529986.786536:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.786546:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.786556:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529986.786584:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529986.786630:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.794507:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.801437:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642752 00000100:00100000:0.0:1788529986.801454:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642752 00000100:00100000:0.0:1788529986.801526:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788529986.801536:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+13:15020:x1875409185642752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788529986.801554:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529986.801586:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabfc242400/0xaa46022e3f18c120 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c119 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.801613:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabfc242400/0xaa46022e3f18c120 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c119 expref: 14 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.801624:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabfc242400/0xaa46022e3f18c120 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c119 expref: 14 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.801632:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc242400, rc 0) 00000100:00100000:3.0:1788529986.801920:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529986.801978:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c120 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.801988:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c120 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529986.802012:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788529986.802029:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c120 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.802036:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabeff36c00/0xaa46022e3f18c119 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c120 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529986.802045:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788529986.802052:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788529986.802098:0:15020:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788529986.802238:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788529986.802246:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788529986.802254:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8cabc3e16800 10000000:01000000:3.0:1788529986.802268:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788529986.802291:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788529986.802294:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788529986.802332:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.802340:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.802349:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529986.802371:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529986.802413:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.802442:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.802533:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185642880 00000100:00100000:1.0:1788529986.802539:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185642880 00000100:00100000:1.0:1788529986.802623:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788529986.802631:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185642880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529986.802639:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529986.802650:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18c12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c127 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.802667:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18c12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c127 expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.802677:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48e00/0xaa46022e3f18c12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c127 expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.802684:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48e00, rc 0) 00000100:00100000:1.0:1788529986.802718:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185642880:12345-0@lo:101:mount.lustre.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.802735:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788529986.802742:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185642880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529986.802753:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c12e expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.802760:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c12e expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529986.803273:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185642752:12345-0@lo:101:mount.lustre.0 Request processed in 1737us (16642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.803280:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:3.0:1788529986.807161:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1788529986.808162:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529986.808424:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788529986.808467:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:3.0:1788529986.808504:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:3.0:1788529986.808575:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:3.0:1788529986.808613:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:3.0:1788529986.808643:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:3.0:1788529986.808685:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:3.0:1788529986.808718:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:3.0:1788529986.808750:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:3.0:1788529986.808792:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:3.0:1788529986.808825:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:3.0:1788529986.808866:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:3.0:1788529986.808971:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:3.0:1788529986.808980:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:3.0:1788529986.809081:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529986.809165:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.809221:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.811546:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643008 00000100:00100000:1.0:1788529986.811561:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643008 00000100:00100000:1.0:1788529986.811640:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788529986.811651:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788529986.812175:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643008:12345-0@lo:501:mount.lustre.0 Request processed in 525us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.812183:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788529986.815718:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529986.815798:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529986.815917:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.816034:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.818940:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643136 00000100:00100000:0.0:1788529986.818983:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643136 00000100:00100000:3.0:1788529986.827498:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788529986.827525:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788529986.828097:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643136:12345-0@lo:503:mount.lustre.0 Request processed in 585us (12178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529986.828106:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788529986.828222:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788529986.828890:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529986.829020:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.829076:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.830523:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.830639:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643264 00000100:00100000:1.0:1788529986.830648:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643264 00000100:00100000:1.0:1788529986.830696:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788529986.830705:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788529986.831305:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643264:12345-0@lo:502:mount.lustre.0 Request processed in 600us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.831314:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788529986.832112:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788529986.832390:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788529986.832447:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:2.0:1788529986.832483:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:2.0:1788529986.832590:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:2.0:1788529986.832632:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:2.0:1788529986.832667:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:2.0:1788529986.832714:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:2.0:1788529986.832750:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:2.0:1788529986.833192:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:2.0:1788529986.833294:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:2.0:1788529986.833335:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:2.0:1788529986.833382:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:2.0:1788529986.833429:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.833503:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.833697:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3e23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.833824:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643392 00000100:00100000:1.0:1788529986.833834:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643392 00000100:00100000:1.0:1788529986.834099:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788529986.834110:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788529986.834365:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643392:12345-0@lo:502:mount.lustre.0 Request processed in 255us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.834373:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788529986.839688:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788529986.840091:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:2.0:1788529986.840109:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788529986.841297:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788529986.841306:0:15034:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788529986.841313:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.841316:0:15034:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788529986.841321:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788529986.841348:0:15034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8caac7263310) 00000020:00000080:2.0:1788529986.841371:0:15034:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788529986.841377:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788529986.841445:0:15034:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabc3e16800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788529986.841454:0:15034:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788529986.841460:0:15034:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa46022e3f18c13c 00010000:00010000:2.0:1788529986.846501:0:15034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788529986.847451:0:15034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788529986.850068:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788529986.854670:0:15034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788529986.854683:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529986.854691:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.854693:0:15034:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788529986.854696:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788529986.854698:0:15034:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788529986.854700:0:15034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788529986.854701:0:15034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788529986.854702:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788529986.854705:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.854706:0:15034:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788529986.854709:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529986.854712:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.854714:0:15034:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788529986.854717:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788529986.854719:0:15034:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788529986.854721:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529986.854724:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.854725:0:15034:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788529986.854727:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788529986.854729:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.854730:0:15034:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788529986.854734:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788529986.862972:0:15034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788529986.862991:0:15034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788529986.862994:0:15034:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788529986.863001:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:0.0:1788529986.863957:0:15020:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788529986.863984:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788529986.864052:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c12e expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864064:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8caac43d0e00/0xaa46022e3f18c127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c12e expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788529986.864072:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc3e16800 from 1 10000000:01000000:0.0:1788529986.864075:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788529986.864113:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864120:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864130:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529986.864157:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788529986.864232:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529986.864282:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643520 00000100:00100000:0.0:1788529986.864289:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643520 00000100:00100000:0.0:1788529986.864332:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788529986.864341:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+15:15020:x1875409185643520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788529986.864355:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788529986.864368:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c143 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864406:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864417:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529986.864426:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabfc243a00, rc 0) 00000100:00100000:1.0:1788529986.865041:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc8c3b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.866050:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185643520:12345-0@lo:101:mount.lustre.0 Request processed in 1705us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.866060:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788529986.866191:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529986.866212:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.866231:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529986.868171:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643648:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788529986.868252:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529986.868299:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54180 going to sleep for 11 seconds 00000100:00100000:2.0:1788529986.869306:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643648 00000100:00100000:2.0:1788529986.869324:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643648 00000100:00100000:2.0:1788529986.869375:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788529986.869385:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185643648:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788529986.869406:0:14334:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788529986.869424:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788529986.869427:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788529986.869557:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185643648:12345-0@lo:256:mount.lustre.0 Request processed in 164us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529986.869566:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788529986.869811:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643648:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788529986.871478:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788529986.871504:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.871529:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529986.871538:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc3e16800 from 1 10000000:01000000:3.0:1788529986.871542:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788529986.871723:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.871732:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.871742:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529986.871831:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788529986.872310:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.872387:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.872647:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643776 00000100:00100000:1.0:1788529986.872655:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643776 00000100:00100000:1.0:1788529986.872736:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788529986.872746:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185643776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529986.872771:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529986.872785:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c151 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.872813:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.872823:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.872832:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49800, rc 0) 00000100:00100000:1.0:1788529986.873039:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185643776:12345-0@lo:101:mount.lustre.0 Request processed in 294us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.873046:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788529986.873291:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788529986.873307:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529986.873316:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788529986.874294:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:3.0:1788529986.875320:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788529986.876153:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788529986.876208:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:3.0:1788529986.876295:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:3.0:1788529986.876337:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:3.0:1788529986.876373:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:3.0:1788529986.876433:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:3.0:1788529986.876617:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:3.0:1788529986.876659:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:3.0:1788529986.876740:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788529986.876748:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:3.0:1788529986.877179:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529986.877250:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529986.877341:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.877388:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185643904 00000100:00100000:1.0:1788529986.877396:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185643904 00000100:00100000:1.0:1788529986.877534:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788529986.877621:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185643904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788529986.878425:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185643904:12345-0@lo:501:mount.lustre.0 Request processed in 871us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529986.878435:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788529986.878634:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185643904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788529986.878680:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788529986.878723:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529986.878862:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54480 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.879294:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644032 00000100:00100000:0.0:1788529986.879302:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644032 00000100:00100000:0.0:1788529986.879374:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788529986.879382:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788529986.880074:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644032:12345-0@lo:503:mount.lustre.0 Request processed in 691us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.880081:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788529986.880166:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788529986.881040:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788529986.881126:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788529986.881174:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.881533:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644160 00000100:00100000:2.0:1788529986.881541:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644160 00000100:00100000:2.0:1788529986.882309:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788529986.882319:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.882667:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644160:12345-0@lo:502:mount.lustre.0 Request processed in 348us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529986.882674:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788529986.883147:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54480 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.883174:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788529986.883526:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788529986.883595:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:0.0:1788529986.883645:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:0.0:1788529986.883684:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:0.0:1788529986.883721:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:1.0:1788529986.884293:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788529986.884346:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:1.0:1788529986.884380:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:1.0:1788529986.884426:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788529986.884508:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529986.884547:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54540 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.884714:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644288 00000100:00100000:0.0:1788529986.884721:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644288 00000100:00100000:0.0:1788529986.884778:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788529986.884795:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788529986.885018:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644288:12345-0@lo:502:mount.lustre.0 Request processed in 224us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.885026:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788529986.885079:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788529986.885168:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788529986.885178:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788529986.906423:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529986.906440:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.906443:0:15038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788529986.906657:0:15038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabc3e16800 00000020:00000080:1.0:1788529986.906663:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529986.906674:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529986.906677:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.906679:0:15038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788529986.906682:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529986.906684:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.906685:0:15038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788529986.906689:0:15038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cabc3e16800 00000020:00000080:1.0:1788529986.906709:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529986.906843:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529986.906848:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.906849:0:15038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788529986.906852:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788529986.906855:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.906856:0:15038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788529986.906859:0:15038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cabc3e16800 00000020:00000080:1.0:1788529986.906861:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788529986.907662:0:15038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788529986.907669:0:15038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788529986.907671:0:15038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788529986.907674:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000020:01000000:2.0:1788529986.918669:0:15020:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788529986.918698:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788529986.918728:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.918742:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788529986.918871:0:15020:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788529986.918874:0:15020:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8cabc3e16800 10000000:01000000:2.0:1788529986.918878:0:15020:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8cabc3e16800 10000000:01000000:2.0:1788529986.918883:0:15020:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788529986.918915:0:15020:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788529986.919010:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788529986.919018:0:15020:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788529986.919029:0:15020:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8cabc3e16800 from 1 10000000:01000000:2.0:1788529986.919032:0:15020:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788529986.919071:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.919079:0:15020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.919089:0:15020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529986.919114:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788529986.919178:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.919223:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd20f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.927729:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644416 00000100:00100000:1.0:1788529986.927748:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644416 00000100:00100000:1.0:1788529986.927820:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788529986.927832:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:15020:x1875409185644416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788529986.927850:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529986.927869:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18c166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c15f expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.927919:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c15f expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.927932:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49e00/0xaa46022e3f18c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c15f expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529986.927956:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49e00, rc 0) 00000100:00100000:1.0:1788529986.928042:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644416:12345-0@lo:101:mount.lustre.0 Request processed in 213us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529986.928050:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788529986.928637:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788529986.928659:0:15020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c166 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.928671:0:15020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c166 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788529986.934375:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788529986.938632:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788529986.940142:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:2.0:1788529986.940211:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:2.0:1788529986.940241:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:2.0:1788529986.940281:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:2.0:1788529986.940315:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:2.0:1788529986.940382:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:2.0:1788529986.940415:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:2.0:1788529986.940444:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:2.0:1788529986.944306:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:2.0:1788529986.944340:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:2.0:1788529986.944357:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:2.0:1788529986.944385:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:2.0:1788529986.944402:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:2.0:1788529986.944418:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:2.0:1788529986.944442:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:2.0:1788529986.944541:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:2.0:1788529986.944877:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:2.0:1788529986.945018:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:2.0:1788529986.945057:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:2.0:1788529986.945093:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:2.0:1788529986.945145:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:2.0:1788529986.945181:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:2.0:1788529986.945214:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:2.0:1788529986.945249:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:2.0:1788529986.945269:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 128 off12440 00000040:00080000:2.0:1788529986.945286:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12664 00000040:00080000:2.0:1788529986.945312:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12888 00000040:00080000:2.0:1788529986.945331:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off12968 00000040:00080000:2.0:1788529986.945348:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13192 00000040:00080000:2.0:1788529986.945372:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13416 00000040:00080000:2.0:1788529986.945389:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13504 00000040:00080000:2.0:1788529986.945405:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13632 00000040:00080000:2.0:1788529986.945420:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13776 00000040:00080000:2.0:1788529986.948143:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13904 00000040:00080000:2.0:1788529986.948236:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14128 00000040:00080000:2.0:1788529986.948286:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14352 00000040:00080000:2.0:1788529986.948323:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14432 00000040:00080000:2.0:1788529986.948352:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14656 00000040:00080000:2.0:1788529986.948408:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14880 00000040:00080000:2.0:1788529986.948445:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 120 off15000 00000040:00080000:2.0:1788529986.948547:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 224 off15224 00000040:00080000:2.0:1788529986.948556:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788529986.948668:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788529986.952988:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.953057:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd20f2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788529986.953277:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644544 00000100:00100000:0.0:1788529986.953287:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644544 00000100:00100000:0.0:1788529986.953344:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788529986.953355:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788529986.953686:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644544:12345-0@lo:501:mount.lustre.0 Request processed in 332us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529986.953693:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788529986.954023:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788529986.954074:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788529986.954117:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.954150:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd20f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788529986.954167:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644672 00000100:00100000:2.0:1788529986.954171:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644672 00000100:00100000:2.0:1788529986.954199:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788529986.954206:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788529986.954351:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644672:12345-0@lo:503:mount.lustre.0 Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529986.954358:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788529986.954400:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644672:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788529986.955129:0:15020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788529986.955203:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.955242:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.955262:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788529986.955279:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644800 00000100:00100000:2.0:1788529986.955284:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644800 00000100:00100000:2.0:1788529986.955312:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529986.955326:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.956225:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644800:12345-0@lo:502:mount.lustre.0 Request processed in 895us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529986.956235:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788529986.956299:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788529986.960594:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:2.0:1788529986.960698:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:2.0:1788529986.960739:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:2.0:1788529986.961112:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:2.0:1788529986.961150:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:2.0:1788529986.961221:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:2.0:1788529986.961259:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:2.0:1788529986.961295:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:2.0:1788529986.961345:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:2.0:1788529986.961383:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:2.0:1788529986.961418:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:2.0:1788529986.963731:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:2.0:1788529986.965610:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:2.0:1788529986.965656:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:2.0:1788529986.965727:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:2.0:1788529986.965782:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:2.0:1788529986.965818:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:2.0:1788529986.965866:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:2.0:1788529986.965953:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:2.0:1788529986.965991:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:2.0:1788529986.966044:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:2.0:1788529986.966109:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:2.0:1788529986.966140:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:2.0:1788529986.966187:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:2.0:1788529986.966222:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 128 off12440 00000040:00080000:2.0:1788529986.966261:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12664 00000040:00080000:2.0:1788529986.966302:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12888 00000040:00080000:2.0:1788529986.966329:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off12968 00000040:00080000:2.0:1788529986.966355:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13192 00000040:00080000:2.0:1788529986.966391:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13416 00000040:00080000:2.0:1788529986.966419:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13504 00000040:00080000:2.0:1788529986.966446:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13632 00000040:00080000:2.0:1788529986.966477:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13776 00000040:00080000:2.0:1788529986.966523:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13904 00000040:00080000:2.0:1788529986.966560:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14128 00000040:00080000:2.0:1788529986.966606:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14352 00000040:00080000:2.0:1788529986.966641:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14432 00000040:00080000:2.0:1788529986.966691:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14656 00000040:00080000:2.0:1788529986.966740:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14880 00000040:00080000:2.0:1788529986.966777:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 120 off15000 00000100:00100000:2.0:1788529986.966834:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.966972:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.967022:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788529986.967055:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185644928 00000100:00100000:2.0:1788529986.967062:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185644928 00000100:00100000:2.0:1788529986.967114:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788529986.967123:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788529986.967348:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185644928:12345-0@lo:502:mount.lustre.0 Request processed in 225us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788529986.967356:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788529986.967421:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185644928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788529986.967485:0:15020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 224 off15224 00000040:00080000:2.0:1788529986.967495:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788529986.985253:0:15043:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788529986.985281:0:15043:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8caac7266620) 00000020:00000080:2.0:1788529986.985303:0:15043:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788529986.985391:0:15043:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8cabc3e16800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788529986.985396:0:15043:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8cabc3e16800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788529986.985399:0:15043:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8cabc3e16800 3 00010000:00080000:2.0:1788529986.985436:0:15043:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caac43f0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1788529986.987144:0:15043:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788529986.990853:0:15043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788529986.990931:0:15043:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788529986.990977:0:15043:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa46022e3f18c174 00000100:00080000:2.0:1788529986.990991:0:15043:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788529986.990998:0:15043:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8caac43f0000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788529986.991038:0:15043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc256300 x1875409185645056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788529986.991063:0:15043:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788529986.993049:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185645056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788529986.993128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788529986.993565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529986.993571:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788529986.993574:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529986.993577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788529986.993824:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 42 count 42 00000020:01000000:2.0:1788529986.993881:0:15020:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788529986.993923:0:15020:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788529986.993955:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c166 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529986.993968:0:15020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5101200/0xaa46022e3f18c15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c166 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788529986.994018:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788529986.994020:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529986.994022:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529986.994023:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529986.994024:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529986.994025:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529986.994027:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529986.994029:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529986.994035:0:15020:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788529986.994039:0:15020:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788529986.994041:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788529986.994042:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529986.994043:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529986.994044:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529986.994045:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529986.994046:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529986.994047:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529986.994048:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529986.994049:0:15020:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788529986.994071:0:15020:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788529986.994087:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185645184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788529986.994133:0:15020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529986.994174:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788529986.994236:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645184 00000100:00100000:1.0:1788529986.994244:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645184 00000100:00100000:1.0:1788529986.994290:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788529986.994298:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15020:x1875409185645184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788529986.994324:0:14331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788529986.994339:0:14331:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788529986.994616:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645056 00000100:00100000:3.0:1788529986.994622:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645056 00000100:00100000:3.0:1788529986.994690:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529986.994696:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875409185645056:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788529986.994718:0:14339:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1788529986.994772:0:14339:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa46022e3f18c17b 00000004:00100000:3.0:1788529986.994789:0:14339:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788529986.994823:0:14339:0:(import.c:65:import_set_state_nolock()) ffff8caac5c75800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788529986.994885:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875409185645056:12345-0@lo:38:llog_process_th.0 Request processed in 186us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529986.994910:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788529986.997810:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cabfc256300 x1875409185645056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788529996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788529986.997826:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788529986.997840:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788529986.997849:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788529986.997856:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788529986.997860:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caac43f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788529986.997867:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875409185645056:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788529987.029147:0:14331:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788529987.029171:0:14331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788529987.029192:0:14355:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788529987.029198:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788529987.029221:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.029240:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.029248:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.029255:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.029293:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.029310:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 18 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529987.029323:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185645312:0@lo:104: 00000100:00100000:1.0:1788529987.029391:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788529987.029443:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.029443:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645312 00010000:00010000:1.0:1788529987.029451:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 18 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.029452:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645312 00000100:00100000:1.0:1788529987.029459:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185645440:0@lo:104: 00000100:00100000:1.0:1788529987.029479:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529987.029654:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645440 00000100:00100000:0.0:1788529987.029658:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645440 00000100:00100000:1.0:1788529987.029665:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788529987.029679:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529987.029687:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:14355:x1875409185645312:12345-0@lo:104: 00010000:00010000:0.0:1788529987.029706:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529987.029770:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788529987.029776:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:14355:x1875409185645312:12345-0@lo:104: Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529987.029783:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529987.029803:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788529987.029809:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185645440:12345-0@lo:104: 00010000:00010000:0.0:1788529987.029817:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529987.029819:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185645312:0@lo:104: 00010000:00010000:0.0:1788529987.029853:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788529987.029858:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788529987.029858:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185645440:12345-0@lo:104: Request processed in 50us (378us total) trans 0 rc 0/0 00010000:00010000:3.0:1788529987.029864:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.029864:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788529987.029879:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242e00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529987.029883:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.029911:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529987.029919:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529987.029925:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529987.029970:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.029977:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529987.029997:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030004:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabfc242e00/0xaa46022e3f18c143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c14a expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030019:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529987.030022:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030028:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:3.0:1788529987.030031:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030048:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788529987.030055:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788529987.030060:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788529987.030079:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030085:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788529987.030091:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030097:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff37400/0xaa46022e3f18c0cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0d3 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030112:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529987.030113:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529987.030115:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529987.030130:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185645568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529987.030159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529987.030188:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645568 00000100:00100000:3.0:1788529987.030190:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788529987.030192:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645568 00000100:00100000:3.0:1788529987.030195:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185645696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788529987.030208:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 19 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529987.030214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529987.030237:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645696 00000100:00100000:0.0:1788529987.030240:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645696 00010000:00010000:0.0:1788529987.030251:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529987.030257:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529987.030264:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:3300:x1875409185645568:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788529987.030265:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788529987.030270:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788529987.030283:0:14325:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788529987.030285:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788529987.030291:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788529987.030295:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.030301:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:3300:x1875409185645696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529987.030308:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529987.030308:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788529987.030312:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030321:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabfc243a00/0xaa46022e3f18c14a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c143 expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529987.030322:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 20 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030334:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030347:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529987.030356:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:3.0:1788529987.030362:0:14324:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005568522s 00010000:00010000:3.0:1788529987.030366:0:14324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030373:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030381:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.030382:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:3300:x1875409185645696:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (167us total) trans 0 rc 0/0 00010000:00010000:3.0:1788529987.030388:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788529987.030388:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788529987.030393:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529987.030397:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030415:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030424:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030433:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788529987.030455:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3300:x1875409185645568:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529987.030461:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788529987.030483:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185645696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788529987.030490:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185645568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788529987.030513:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabfc243200/0xaa46022e3f18c0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c0cc expref: 17 pid: 14333 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788529987.030519:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185645440:0@lo:104: 00010000:00010000:3.0:1788529987.030527:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030533:0:14355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030538:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529987.030544:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c182 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529987.031216:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788529987.035758:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:15020:x1875409185645184:12345-0@lo:253:mount.lustre.0 Request processed in 41449us (41612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529987.035776:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788529987.035791:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15020:1875409185645184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788529987.035807:0:15020:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788529987.035810:0:15020:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788529987.035812:0:15020:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788529987.035813:0:15020:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788529987.035814:0:15020:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788529987.035816:0:15020:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788529987.035817:0:15020:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788529987.035835:0:15020:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788529987.035837:0:15020:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788529987.035838:0:15020:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788529987.035862:0:15020:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788529987.039520:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529987.039830:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529987.040031:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529987.040170:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788529987.040299:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788529987.040495:0:15020:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788529987.041667:0:15020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788529987.076412:0:15020:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788529987.076420:0:15020:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788529987.076449:0:15020:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788529987.076475:0:15020:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788529987.534280:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788529988.559395:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788529988.559404:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc3e16800 from 7 10000000:01000000:2.0:1788529988.559409:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788529988.559459:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529988.559471:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529988.559482:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529988.559510:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185645824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529988.560311:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529988.560516:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529988.560568:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788529988.560728:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645824 00000100:00100000:3.0:1788529988.560736:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645824 00000100:00100000:3.0:1788529988.560790:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788529988.560800:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+16:14336:x1875409185645824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788529988.560814:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788529988.560830:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c189 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529988.560856:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 17 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529988.560868:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 17 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529988.560877:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d1e00, rc 0) 00000100:00100000:3.0:1788529988.561085:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:14336:x1875409185645824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529988.561092:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788529988.561392:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185645824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529988.561413:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529988.561438:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529988.561512:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185645952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788529988.561564:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529988.561822:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529988.569317:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185645952 00000100:00100000:1.0:1788529988.569334:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185645952 00000100:00100000:1.0:1788529988.569397:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788529988.569407:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:14336:x1875409185645952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788529988.569441:0:14334:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788529988.569462:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788529988.569466:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788529988.569793:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:14336:x1875409185645952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 386us (8226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529988.569800:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788529988.569859:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185645952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788529988.569941:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788529988.569952:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.569963:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788529988.569980:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788529988.569983:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf54e5800 from 7 10000000:01000000:1.0:1788529988.569986:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788529988.570016:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.570024:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.570033:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529988.570054:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185646080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788529988.570355:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529988.570388:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54540 going to sleep for 11 seconds 00000100:00100000:1.0:1788529988.570406:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646080 00000100:00100000:1.0:1788529988.570411:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646080 00000100:00100000:1.0:1788529988.570434:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788529988.570441:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+17:14336:x1875409185646080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788529988.570451:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788529988.570467:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c197 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.570503:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.570513:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.570522:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788529988.571478:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:14336:x1875409185646080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1034us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529988.571488:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788529988.571683:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185646080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788529988.571704:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529988.571715:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788529988.571777:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185646208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788529988.571812:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788529988.571843:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788529988.571933:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646208 00000100:00100000:1.0:1788529988.571940:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646208 00000100:00100000:1.0:1788529988.571982:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788529988.571990:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:14336:x1875409185646208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788529988.572009:0:14333:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788529988.572025:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788529988.572027:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788529988.573366:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:14336:x1875409185646208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1369us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529988.573379:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788529988.573432:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185646208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788529988.573495:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788529988.573504:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529988.573515:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529989.582213:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529990.607199:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529991.634470:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788529992.270633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529992.270639:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788529992.270642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788529992.270644:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788529992.270699:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185646464:0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.271587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529992.271645:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788529992.271653:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185646336:0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.271681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529992.271747:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646336 00000100:00100000:3.0:1788529992.271755:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646336 00000100:00100000:3.0:1788529992.271799:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788529992.271808:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3303:x1875409185646336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.271891:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185646592:0@lo:400:kworker.0 00000100:00100000:3.0:1788529992.275914:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3303:x1875409185646336:12345-0@lo:400:kworker.0 Request processed in 4084us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529992.275932:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788529992.279678:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185646336:0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.279752:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646464 00000100:00100000:0.0:1788529992.279759:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646464 00000100:00100000:0.0:1788529992.279825:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529992.279834:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.279945:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185646464:12345-0@lo:400:kworker.0 Request processed in 111us (8358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529992.279952:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788529992.280052:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8caac779ce00 x1875409185646464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788529992.280064:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185646464:0@lo:400:kworker.0 00000100:00100000:0.0:1788529992.280093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529992.284316:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646592 00000100:00100000:1.0:1788529992.284331:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646592 00000100:00100000:1.0:1788529992.284408:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788529992.284418:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185646592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529992.284509:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185646592:12345-0@lo:400:kworker.0 Request processed in 92us (4414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529992.284516:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788529992.285123:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788529992.287431:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8caac779f800 x1875409185646592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529992.287451:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185646592:0@lo:400:kworker.0 00010000:00010000:3.0:1788529992.660391:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788529993.044356:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788529993.681816:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788529993.716667:0:15387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788529994.703266:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529995.736072:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788529996.237981:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788529981/real 1788529981] req@ffff8cabfcb1b100 x1875409185640960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529996.238024:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cabfcb1b100 x1875409185640960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529996.238034:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788529981/real 1788529981] req@ffff8cabfcb19880 x1875409185641088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529996.238045:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cabfcb19880 x1875409185641088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788529996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788529996.238068:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788529996.238092:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788529996.238097:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185640960:0@lo:8:kworker.0 00000100:00080000:3.0:1788529996.238103:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788529996.238108:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788529996.238111:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185641088:0@lo:8:kworker.0 00000100:00080000:1.0:1788529996.240202:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788529996.240208:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788529996.240212:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788529996.240222:0:12190:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788529996.240228:0:12190:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788529996.240237:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cabc35b7000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1788529996.240261:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfcb1b100 x1875409185646848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788529996.240278:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788529996.240281:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788529996.240283:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788529996.240287:0:12190:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788529996.240289:0:12190:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788529996.240310:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1788529996.240321:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfcb1bb80 x1875409185646976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788529996.240379:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185647104:0@lo:400:kworker.0 00000100:00100000:1.0:1788529996.240462:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529996.240532:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788529996.240537:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185647232:0@lo:400:kworker.0 00000100:00100000:1.0:1788529996.240558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529996.240593:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647104 00000100:00100000:1.0:1788529996.240601:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647104 00000100:00100000:1.0:1788529996.240647:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647232 00000100:00100000:1.0:1788529996.240649:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647232 00000100:00100000:1.0:1788529996.240677:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788529996.240686:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185647104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529996.240737:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185647104:12345-0@lo:400:kworker.0 Request processed in 52us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529996.240756:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788529996.240937:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788529996.240948:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185646720:0@lo:400:kworker.0 00000100:00100000:3.0:1788529996.240985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788529996.241018:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788529996.241031:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646720 00000100:00100000:3.0:1788529996.241035:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646720 00000100:00100000:3.0:1788529996.241060:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788529996.241066:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3300:x1875409185646720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788529996.241108:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3300:x1875409185646720:12345-0@lo:400:kworker.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788529996.241115:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788529996.241168:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185646720:0@lo:400:kworker.0 00000100:00100000:3.0:1788529996.241190:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185646848:0@lo:8:kworker.0 00000100:00100000:3.0:1788529996.241221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788529996.241238:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185646976:0@lo:8:kworker.0 00000100:00100000:3.0:1788529996.241258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788529996.241319:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfcb1a680 x1875409185647104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529996.241332:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185647104:0@lo:400:kworker.0 00000100:00100000:1.0:1788529996.243075:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788529996.243110:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185647232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788529996.246300:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185647232:12345-0@lo:400:kworker.0 Request processed in 3197us (5729us total) trans 0 rc 0/0 00010000:00080000:3.0:1788529996.249072:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfcb18700 x1875409185647232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788529996.249095:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185647232:0@lo:400:kworker.0 00000100:00100000:0.0:1788529996.257011:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646848 00000100:00100000:0.0:1788529996.257036:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646848 00000100:00100000:0.0:1788529996.257083:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185646976 00000100:00100000:0.0:1788529996.257087:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185646976 00000100:00100000:0.0:1788529996.257104:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529996.257114:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185646848:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788529996.257168:0:15022:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1788529996.257215:0:15022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18c1a5 00002000:00100000:0.0:1788529996.257235:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cabc61f5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788529996.257240:0:15022:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788529996.257243:0:15022:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788529996.258482:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00080000:0.0:1788529996.259271:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788529996.259321:0:15022:0:(import.c:65:import_set_state_nolock()) ffff8cabc61f2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788529996.259449:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875409185646848:12345-0@lo:8:kworker.0 Request processed in 2334us (18225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529996.259475:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788529996.259507:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788529996.260905:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185646976:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788529996.260934:0:15022:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788529996.261012:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185646976:12345-0@lo:8:kworker.0 Request processed in 1497us (19752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788529996.261021:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788529996.261224:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfcb1b100 x1875409185646848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529996.261238:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788529996.261250:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788529996.261276:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788529996.261283:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788529996.261287:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabc35b7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788529996.261315:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788529996.261323:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185646848:0@lo:8:kworker.0 00000100:00080000:1.0:1788529996.261339:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788529996.261343:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788529996.261346:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185646976:0@lo:8:kworker.0 00000004:00080000:0.0:1788529996.261589:0:14362:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788529996.261614:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14362:1875409185647488:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788529996.261667:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788529996.261694:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e7cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788529996.261710:0:14361:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788529996.262244:0:14361:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506232349098ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788529996.262273:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647488 00000100:00100000:0.0:1788529996.262281:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647488 00000100:00100000:0.0:1788529996.262334:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788529996.262343:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14362:x1875409185647488:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788529996.264868:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788529996.264927:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185647360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788529996.265016:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529996.265095:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647360 00000100:00100000:1.0:1788529996.265104:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647360 00000100:00100000:1.0:1788529996.265164:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788529996.265174:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185647360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788529996.265217:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788529996.265273:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875409185647360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788529996.265281:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788529996.265334:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8caac779df80 x1875409185647360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788529996.265357:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185647360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788529996.265925:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788529996.274205:0:15022:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788529996.274224:0:15022:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788529996.274232:0:15022:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1788529996.283688:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.283703:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.283726:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.283732:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.283748:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.283772:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.283796:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.283805:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.283871:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.284525:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.284532:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.284541:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.284545:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.284549:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.284559:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.284568:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.284588:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284642:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529996.284653:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284674:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.284680:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284691:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284713:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284722:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022bb6183/0xaa46022e3f18c1ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284747:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529996.284750:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284756:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.284759:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284765:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284775:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.284802:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.284803:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.284805:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.284845:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788529996.284850:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4d75f58/0xaa46022e3f18c1b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529996.285473:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.285481:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.285493:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.285496:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.285501:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.285511:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.285520:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.285528:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.285601:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.286180:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.286187:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.286197:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.286200:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.286205:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.286215:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.286223:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.286231:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286283:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529996.286290:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286298:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.286304:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286313:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286331:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286338:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006a8bfec/0xaa46022e3f18c1ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286359:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529996.286363:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286371:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.286381:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286391:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286476:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.286486:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.286489:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.286492:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.286563:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788529996.286569:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfcd325e/0xaa46022e3f18c1c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529996.287323:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.287332:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287352:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.287356:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.287361:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287374:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287383:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287392:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287419:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.287855:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.287862:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287871:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.287874:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.287878:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287887:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287934:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287940:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.287950:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788529996.289859:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529996.289876:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.289904:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.289910:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.289923:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.289946:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.289955:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000836dc94/0xaa46022e3f18c1c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.289990:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529996.289995:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.290002:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.290006:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.290015:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.290025:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.290032:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc7c7c18/0xaa46022e3f18c1cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.290046:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.290048:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.290050:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.290923:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.290934:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.290950:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.290955:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.290963:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.290978:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.290988:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.290997:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291031:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788529996.291321:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529996.291328:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.291336:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.291346:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.291355:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.291369:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.291377:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ee8f18/0xaa46022e3f18c1d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.291393:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.291402:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.291404:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.291544:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.291550:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291560:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.291563:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.291567:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291576:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291584:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291592:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.291609:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.292087:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.292094:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292103:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.292111:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.292116:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292126:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292135:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292142:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292150:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788529996.292525:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.292531:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292539:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.292543:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.292546:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292555:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292564:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292577:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.292586:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788529996.293032:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.293039:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293048:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.293051:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.293056:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293064:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293073:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293080:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293088:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788529996.293214:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788529996.293222:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293232:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.293236:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293247:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293263:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293277:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b109a997/0xaa46022e3f18c1dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293297:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788529996.293301:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293308:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.293311:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293318:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293327:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293335:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4adb56/0xaa46022e3f18c1e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293348:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788529996.293351:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293358:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc243200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.293368:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293376:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293386:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293405:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018aeca1c/0xaa46022e3f18c1eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293418:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788529996.293421:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293429:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788529996.293432:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293439:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788529996.293449:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529996.293454:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788529996.293456:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d28258f/0xaa46022e3f18c1f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293459:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293471:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788529996.293472:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.293474:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.293474:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788529996.293476:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.293478:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293487:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293494:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293502:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.293569:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.294015:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.294021:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294030:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.294034:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.294038:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294047:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294066:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294073:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294081:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788529996.294469:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.294475:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294483:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.294487:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.294491:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294500:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294508:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294514:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.294536:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788529996.295981:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788529996.296000:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296016:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529996.296021:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296053:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296085:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296094:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af97e3b1/0xaa46022e3f18c1f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296138:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788529996.296144:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296151:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529996.296154:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296162:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296173:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296180:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008425cf54/0xaa46022e3f18c200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296209:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529996.296214:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296221:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabfc242c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529996.296225:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296234:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296245:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296253:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5a6551/0xaa46022e3f18c207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.296267:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.296269:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.296271:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788529996.296989:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.299833:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.299849:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.299868:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.299873:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.299880:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.299929:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.299940:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.299950:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.299976:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.300448:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.300455:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300465:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.300475:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.300480:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300489:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300496:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300503:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300520:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788529996.300535:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788529996.300540:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300548:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529996.300553:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300562:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300577:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300595:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c20e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300614:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529996.300618:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300624:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529996.300628:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300636:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300646:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300653:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.300664:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.300666:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.300668:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.301110:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.301115:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301129:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.301132:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.301136:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301144:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301152:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301158:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301172:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529996.301181:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529996.301184:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301191:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529996.301195:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301202:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301223:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301230:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c21c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301246:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.301248:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.301249:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.301633:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.301639:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301648:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.301651:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.301655:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301665:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301673:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301680:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301704:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529996.301712:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529996.301716:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301722:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529996.301725:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301733:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301744:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301752:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.301765:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.301767:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.301769:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.302225:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.302231:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302239:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.302247:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.302252:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302261:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302269:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302276:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302289:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788529996.302297:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788529996.302301:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302308:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788529996.302312:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302319:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302330:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302347:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c22a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302361:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.302362:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.302364:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.302741:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.302747:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302755:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.302758:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.302763:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.302771:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.306362:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.317601:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.317627:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.317698:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788529996.317734:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529996.317752:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.317768:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529996.317814:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.317830:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.317860:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.317868:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97b9f81/0xaa46022e3f18c231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.317920:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.317922:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.317924:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.323033:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.323059:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.323079:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.323083:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.323090:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.323106:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.323118:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.323127:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.323157:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788529996.323221:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788529996.323235:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.323251:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788529996.323257:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.323269:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.323293:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.323315:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030d4cc83/0xaa46022e3f18c238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788529996.323343:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.323345:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788529996.323346:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.326933:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.326946:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.326964:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.326968:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.326974:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.326989:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.327008:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.327017:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.327049:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788529996.327912:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788529996.328595:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.328607:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.328622:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.328629:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.328641:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.328689:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.328698:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004311e9c7/0xaa46022e3f18c23f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.328733:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.328735:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.328737:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.333509:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.333538:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.334546:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.334558:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.334568:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.334965:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.334983:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.334990:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.335289:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788529996.336142:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.336164:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.336180:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.336184:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.336190:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.336202:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.336211:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.336219:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347350:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788529996.347373:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347401:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.347407:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347420:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347450:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347459:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b10fa8bc/0xaa46022e3f18c246 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347514:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.347519:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347525:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.347528:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347536:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347546:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.347554:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.347556:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.347558:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.348379:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788529996.348391:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c3bca/0xaa46022e3f18c24d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788529996.356969:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.356992:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.357644:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.357649:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.357658:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.357678:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.357692:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.357702:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.357797:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.357807:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.357816:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.357822:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.357848:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.357869:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.357880:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.357882:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.357884:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788529996.358112:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788529996.358119:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f5ebabe/0xaa46022e3f18c254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.359174:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.362806:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.362826:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.362850:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.362856:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.362864:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.362926:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.362939:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.362948:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.362972:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788529996.363269:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.363279:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.363288:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.363293:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.363304:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.363325:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.363334:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1b7efdb/0xaa46022e3f18c25b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.363370:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.363372:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.363374:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.364362:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.364373:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.364389:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.364462:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.364470:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.364483:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.364493:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.364636:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.364664:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788529996.365328:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.365340:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.365350:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.365355:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.365365:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.365381:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.365389:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b964323f/0xaa46022e3f18c262 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.365420:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.365422:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.365424:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788529996.368252:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788529996.368267:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.368288:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788529996.368293:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788529996.368302:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.368320:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.368332:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.368341:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788529996.368427:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788529996.368697:0:15022:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788529996.370021:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14362:x1875409185647488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 107656us (108330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788529996.370048:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788529996.372633:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14362:1875409185647488:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788529996.372665:0:14362:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788529996.372738:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14362:1875409185647616:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788529996.374332:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788529996.374348:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.374377:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788529996.374384:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788529996.374544:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788529996.374622:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1f56c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788529996.374662:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.374691:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.374699:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037eaece7/0xaa46022e3f18c269 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788529996.374725:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.374727:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529996.374730:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788529996.374888:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647616 00000100:00100000:2.0:1788529996.374926:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647616 00000100:00100000:2.0:1788529996.374990:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788529996.375003:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14362:x1875409185647616:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788529996.375291:0:15023:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788529996.400652:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14362:x1875409185647616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25633us (26093us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788529996.400670:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788529996.400754:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14362:1875409185647616:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788529996.400775:0:14362:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788529996.752073:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788529997.607622:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788529997.607643:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788529997.777456:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529998.799384:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788529999.824178:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530000.848027:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530001.486043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530001.486052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530001.486067:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530001.486078:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1788530001.486086:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788530001.486106:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788530001.486133:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc130380 x1875409185648000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530001.486206:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185647744:0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.486290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530001.486349:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530001.486354:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185648256:0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.486377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530001.486406:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185647872:0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.486429:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530001.486443:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530001.486447:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185648128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.486463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530001.486485:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185648000:0@lo:8:kworker.0 00000100:00100000:3.0:1788530001.486517:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530001.486805:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647744 00000100:00100000:3.0:1788530001.486817:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647744 00000100:00100000:3.0:1788530001.486866:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530001.486875:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3301:x1875409185647744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.486959:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:3301:x1875409185647744:12345-0@lo:400:kworker.0 Request processed in 84us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530001.486967:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530001.487002:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648256 00000100:00100000:3.0:1788530001.487005:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648256 00000100:00100000:3.0:1788530001.487035:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648128 00000100:00100000:3.0:1788530001.487037:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648128 00000100:00100000:3.0:1788530001.487059:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530001.487064:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185648256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.487094:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875409185648256:12345-0@lo:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530001.487100:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530001.487109:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530001.487114:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185648128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.487137:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185648128:12345-0@lo:400:kworker.0 Request processed in 23us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530001.487142:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788530001.487232:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfc132300 x1875409185648256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530001.487247:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875409185648256:0@lo:400:kworker.0 00000100:00100000:3.0:1788530001.487257:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185647744:0@lo:400:kworker.0 00000100:00080000:3.0:1788530001.487281:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788530001.487296:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfc130000 x1875409185648128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530001.487305:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185648128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530001.487717:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185647872 00000100:00100000:1.0:1788530001.487726:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185647872 00000100:00100000:1.0:1788530001.487779:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648000 00000100:00100000:1.0:1788530001.487784:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648000 00000100:00100000:1.0:1788530001.487798:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530001.487808:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530001.487858:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185647872:12345-0@lo:400:kworker.0 Request processed in 54us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530001.487864:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530001.487876:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530001.487880:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875409185648000:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530001.487928:0:15021:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788530001.493407:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530001.493449:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530001.493665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530001.493756:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530001.493799:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788530001.493825:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185647872:0@lo:400:kworker.0 00000100:00100000:0.0:1788530001.494478:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648384 00000100:00100000:0.0:1788530001.494490:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648384 00000100:00100000:0.0:1788530001.494563:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530001.494575:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185648384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530001.494627:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788530001.494700:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185648384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530001.494707:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530001.496628:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530001.517758:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875409185648000:12345-0@lo:8:kworker.0 Request processed in 29801us (31165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530001.517790:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788530001.519093:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530001.519107:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788530001.519113:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185648000:0@lo:8:kworker.0 00010000:00010000:3.0:1788530001.873224:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530002.895050:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530003.346064:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530003.919387:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788530004.083572:0:15741:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788530004.083576:0:15741:0:(obd_mount.c:928:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788530004.084179:0:15741:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8caac43f2800 00000020:01000004:2.0:1788530004.084221:0:15741:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788530004.084235:0:15741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788530004.084249:0:15741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8caac7260000) 00000020:00000080:2.0:1788530004.084264:0:15741:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788530004.129015:0:15741:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788530004.129298:0:15741:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788530004.130463:0:15741:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788530004.130741:0:15741:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788530004.130982:0:15741:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788530004.131349:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 537: rc = 0 00100000:10000000:1.0:1788530004.131473:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 537: rc = 0 00100000:10000000:1.0:1788530004.131591:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 537: rc = 0 00100000:10000000:1.0:1788530004.134021:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 575: rc = 0 00100000:10000000:1.0:1788530004.134365:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 575: rc = 0 00100000:10000000:1.0:1788530004.137388:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 575: rc = 0 00100000:10000000:1.0:1788530004.138852:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 575: rc = 0 00100000:10000000:1.0:1788530004.139299:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 575: rc = 0 00100000:10000000:1.0:1788530004.140930:0:15741:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 575: rc = 0 00000020:00000080:1.0:1788530004.142432:0:15741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788530004.142448:0:15741:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788530004.142461:0:15741:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa46022e3f18c277 00000020:01000004:1.0:1788530004.142470:0:15741:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788530004.142501:0:15741:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788530004.142505:0:15741:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788530004.142510:0:15741:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788530004.142553:0:15741:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788530004.142557:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788530004.142559:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530004.142560:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530004.142564:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530004.142565:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530004.142566:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530004.142568:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530004.142569:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530004.142570:0:15741:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530004.142573:0:15741:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788530004.142575:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530004.142576:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530004.142577:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530004.142578:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530004.142579:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530004.142580:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530004.142581:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530004.142582:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530004.142583:0:15741:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530004.142707:0:15741:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788530004.142727:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530004.142798:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.142931:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530004.143044:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648512 00000100:00100000:3.0:1788530004.143053:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648512 00000100:00100000:3.0:1788530004.143108:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530004.143117:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15741:x1875409185648512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788530004.143143:0:14334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788530004.143146:0:14334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788530004.143150:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788530004.182406:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15741:x1875409185648512:12345-0@lo:253:mount.lustre.0 Request processed in 39273us (39592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.182427:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788530004.182797:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530004.182817:0:15741:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788530004.182822:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530004.182823:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530004.182825:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530004.182827:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530004.182829:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530004.182830:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530004.182832:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530004.182833:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530004.182835:0:15741:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788530004.182870:0:15741:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8caac43f2800 from lustre-OST0001 10000000:01000000:0.0:1788530004.182928:0:15741:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788530004.182932:0:15741:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788530004.182940:0:15741:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8caac43f2800 10000000:01000000:0.0:1788530004.182946:0:15741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530004.182961:0:15741:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530004.190349:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530004.202157:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530004.202180:0:15741:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff8caac43f2800 from 1 10000000:01000000:0.0:1788530004.202183:0:15741:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788530004.202234:0:15741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530004.202246:0:15741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530004.202257:0:15741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530004.202284:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530004.202356:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530004.202405:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530004.203175:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648640 00000100:00100000:3.0:1788530004.203184:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648640 00000100:00100000:3.0:1788530004.203240:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788530004.203250:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+18:15741:x1875409185648640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530004.203265:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530004.203281:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac43d1200/0xaa46022e3f18c285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c27e expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.203308:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac43d1200/0xaa46022e3f18c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c27e expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.203320:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac43d1200/0xaa46022e3f18c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c27e expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.203328:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d1200, rc 0) 00000100:00100000:3.0:1788530004.203403:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185648640:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.203410:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530004.203532:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530004.203550:0:15741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c285 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.203561:0:15741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c285 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.203791:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530004.203820:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.203856:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.203973:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648768 00000100:00100000:2.0:1788530004.203979:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648768 00000100:00100000:2.0:1788530004.204013:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530004.204021:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185648768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.204184:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185648768:12345-0@lo:501:mount.lustre.0 Request processed in 163us (363us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530004.204199:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788530004.204273:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648768:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530004.204290:0:15741:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788530004.204439:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530004.204463:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.204495:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.204583:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185648896 00000100:00100000:2.0:1788530004.204587:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185648896 00000100:00100000:2.0:1788530004.204606:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530004.204612:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185648896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.204752:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185648896:12345-0@lo:501:mount.lustre.0 Request processed in 139us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530004.204758:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788530004.206111:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185648896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530004.206308:0:15741:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530004.206334:0:15741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c285 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.206345:0:15741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030600/0xaa46022e3f18c27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c285 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530004.206358:0:15741:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8caac43f2800 10000000:01000000:1.0:1788530004.206365:0:15741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788530004.206389:0:15741:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788530004.206590:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530004.206598:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530004.206607:0:15741:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788530004.206611:0:15741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530004.206629:0:15741:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788530004.206680:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530004.206685:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530004.206691:0:15741:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8caac43f2800 10000000:01000000:1.0:1788530004.206695:0:15741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788530004.206724:0:15741:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788530004.206728:0:15741:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788530004.206768:0:15741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.206778:0:15741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.206798:0:15741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.206820:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530004.206878:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.206949:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.207235:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649024 00000100:00100000:2.0:1788530004.207242:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649024 00000100:00100000:2.0:1788530004.207302:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788530004.207313:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+19:15741:x1875409185649024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530004.207327:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530004.207343:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5101a00/0xaa46022e3f18c293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c28c expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.207369:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5101a00/0xaa46022e3f18c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c28c expref: 20 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.207380:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5101a00/0xaa46022e3f18c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c28c expref: 20 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.207389:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101a00, rc 0) 00000100:00100000:2.0:1788530004.207433:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649024:12345-0@lo:101:mount.lustre.0 Request processed in 123us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.207440:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788530004.208117:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530004.208134:0:15741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c293 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.208144:0:15741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c293 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530004.210182:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788530004.211155:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530004.211407:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788530004.211452:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:1.0:1788530004.211487:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:1.0:1788530004.211533:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:1.0:1788530004.211567:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:1.0:1788530004.211596:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:1.0:1788530004.211963:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:1.0:1788530004.212011:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:1.0:1788530004.212059:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:1.0:1788530004.212114:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:1.0:1788530004.212122:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:1.0:1788530004.212208:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530004.212277:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.212325:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.212388:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649152 00000100:00100000:2.0:1788530004.212401:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649152 00000100:00100000:2.0:1788530004.212450:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788530004.212460:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.213125:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649152:12345-0@lo:501:mount.lustre.0 Request processed in 665us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.213134:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788530004.214177:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530004.214231:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530004.214288:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.214475:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530004.215054:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649280 00000100:00100000:0.0:1788530004.215065:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649280 00000100:00100000:2.0:1788530004.224026:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788530004.224039:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530004.224975:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649280:12345-0@lo:503:mount.lustre.0 Request processed in 934us (10683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.224986:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788530004.230545:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788530004.233790:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530004.233918:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530004.234006:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.234044:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc35a56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.234800:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649408 00000100:00100000:2.0:1788530004.234809:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649408 00000100:00100000:2.0:1788530004.234871:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788530004.234882:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530004.235198:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649408:12345-0@lo:502:mount.lustre.0 Request processed in 317us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.235206:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788530004.235326:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530004.235595:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788530004.235658:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:3.0:1788530004.235697:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:3.0:1788530004.235744:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:3.0:1788530004.235779:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:3.0:1788530004.235809:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:3.0:1788530004.235852:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:3.0:1788530004.235883:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:3.0:1788530004.235990:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:3.0:1788530004.236030:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530004.236079:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530004.236109:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530004.236184:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649536 00000100:00100000:0.0:1788530004.236190:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649536 00000100:00100000:0.0:1788530004.236231:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530004.236239:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530004.236398:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649536:12345-0@lo:502:mount.lustre.0 Request processed in 160us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530004.236412:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788530004.236574:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530004.236636:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:3.0:1788530004.236657:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788530004.237649:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788530004.237658:0:15742:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788530004.237666:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.237668:0:15742:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788530004.237675:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530004.237690:0:15742:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cabfce34c98) 00000020:00000080:1.0:1788530004.237713:0:15742:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788530004.237718:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788530004.237789:0:15742:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8caac43f2800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788530004.237797:0:15742:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788530004.237804:0:15742:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa46022e3f18c2a1 00010000:00010000:1.0:1788530004.246704:0:15742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788530004.247167:0:15742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788530004.248591:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788530004.251083:0:15742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788530004.251095:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.251101:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.251104:0:15742:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788530004.251107:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530004.251112:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.251113:0:15742:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788530004.251116:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788530004.251118:0:15742:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788530004.251121:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.251124:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.251125:0:15742:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788530004.251128:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530004.251135:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.251136:0:15742:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788530004.251140:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788530004.251203:0:15742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.251206:0:15742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.251208:0:15742:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788530004.251212:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:2.0:1788530004.251360:0:15741:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788530004.251379:0:15741:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788530004.251403:0:15741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c293 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.251415:0:15741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabcfc48200/0xaa46022e3f18c28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c293 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530004.251435:0:15741:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8caac43f2800 from 1 10000000:01000000:2.0:1788530004.251438:0:15741:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530004.251474:0:15741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.251493:0:15741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.251504:0:15741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530004.251531:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530004.251598:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.251654:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.251948:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649664 00000100:00100000:1.0:1788530004.251956:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649664 00000100:00100000:1.0:1788530004.255779:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530004.255799:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185649664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530004.255822:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530004.255844:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c2a8 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.255878:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 21 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.255909:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 21 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.255920:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788530004.256005:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:15741:x1875409185649664:12345-0@lo:101:mount.lustre.0 Request processed in 212us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.256013:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788530004.256503:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530004.256523:0:15741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.256532:0:15741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530004.257098:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649792:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788530004.257152:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.268783:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530004.268958:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649792 00000100:00100000:3.0:1788530004.268968:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649792 00000100:00100000:3.0:1788530004.269019:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530004.269029:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:15741:x1875409185649792:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788530004.269078:0:14333:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788530004.269094:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530004.269098:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530004.269101:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 7 00000100:00100000:3.0:1788530004.269221:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:15741:x1875409185649792:12345-0@lo:256:mount.lustre.0 Request processed in 193us (12070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.269229:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788530004.271359:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649792:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788530004.271981:0:15741:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530004.272017:0:15741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.272030:0:15741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530004.272040:0:15741:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac43f2800 from 1 10000000:01000000:2.0:1788530004.272044:0:15741:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530004.272078:0:15741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.272087:0:15741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.272097:0:15741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530004.272117:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530004.272174:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.272199:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530004.272549:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185649920 00000100:00100000:3.0:1788530004.272556:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185649920 00000100:00100000:3.0:1788530004.272609:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530004.272619:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:15741:x1875409185649920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530004.272632:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530004.272655:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c2b6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.272681:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.272692:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530004.272702:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d1a00, rc 0) 00000100:00100000:3.0:1788530004.272740:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185649920:12345-0@lo:101:mount.lustre.0 Request processed in 123us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.272748:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788530004.275933:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185649920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530004.275981:0:15741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.276001:0:15741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530004.276782:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:2.0:1788530004.277427:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530004.277666:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788530004.277726:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788530004.277773:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788530004.277806:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788530004.277835:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788530004.277877:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788530004.277938:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:2.0:1788530004.277970:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:2.0:1788530004.278032:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788530004.278039:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:2.0:1788530004.278110:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.278176:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.278207:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530004.278390:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650048 00000100:00100000:3.0:1788530004.278399:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650048 00000100:00100000:3.0:1788530004.278438:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788530004.278446:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530004.278687:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650048:12345-0@lo:501:mount.lustre.0 Request processed in 241us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.278696:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788530004.280727:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.280786:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530004.280857:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.281005:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530004.281078:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650176 00000100:00100000:0.0:1788530004.281086:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650176 00000100:00100000:1.0:1788530004.281299:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530004.281312:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530004.282338:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650176:12345-0@lo:503:mount.lustre.0 Request processed in 1024us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.282360:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788530004.282484:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530004.283147:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530004.283221:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530004.283323:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.283406:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482300 going to sleep for 11 seconds 00000100:00100000:0.0:1788530004.283834:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650304 00000100:00100000:0.0:1788530004.283843:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650304 00000100:00100000:0.0:1788530004.283990:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788530004.284014:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530004.284416:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650304:12345-0@lo:502:mount.lustre.0 Request processed in 404us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530004.284425:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788530004.284796:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530004.285071:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788530004.285120:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:2.0:1788530004.285164:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:2.0:1788530004.285198:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:2.0:1788530004.285229:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:2.0:1788530004.285298:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:2.0:1788530004.285334:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:2.0:1788530004.285369:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:2.0:1788530004.285402:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530004.285446:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530004.285694:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650432 00000100:00100000:0.0:1788530004.285700:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650432 00000100:00100000:0.0:1788530004.285736:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788530004.285743:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530004.285910:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650432:12345-0@lo:502:mount.lustre.0 Request processed in 152us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530004.285918:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530004.286146:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc3ee99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.286163:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530004.286243:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788530004.286252:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788530004.289007:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530004.289019:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289022:0:15746:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788530004.289032:0:15746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8caac43f2800 00000020:00000080:1.0:1788530004.289034:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530004.289041:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.289044:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289045:0:15746:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788530004.289047:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530004.289050:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289052:0:15746:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788530004.289055:0:15746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8caac43f2800 00000020:00000080:1.0:1788530004.289057:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530004.289115:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.289119:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289120:0:15746:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788530004.289123:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530004.289125:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289127:0:15746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530004.289130:0:15746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8caac43f2800 00000020:00000080:1.0:1788530004.289133:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530004.289162:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530004.289166:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530004.289168:0:15746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788530004.289171:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:2.0:1788530004.291095:0:15741:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788530004.291117:0:15741:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530004.291141:0:15741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.291155:0:15741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530004.291214:0:15741:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788530004.291217:0:15741:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8caac43f2800 10000000:01000000:2.0:1788530004.291221:0:15741:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8caac43f2800 10000000:01000000:2.0:1788530004.291226:0:15741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530004.291240:0:15741:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.201.152@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788530004.291312:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530004.291319:0:15741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530004.291333:0:15741:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff8caac43f2800 from 1 10000000:01000000:2.0:1788530004.291336:0:15741:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788530004.291376:0:15741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.291386:0:15741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.291406:0:15741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530004.291434:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530004.291511:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.291557:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.291618:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650560 00000100:00100000:1.0:1788530004.291626:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650560 00000100:00100000:1.0:1788530004.291684:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788530004.291694:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:15741:x1875409185650560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530004.291708:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530004.291728:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18c2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c2c4 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.291753:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c2c4 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.291764:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49400/0xaa46022e3f18c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2c4 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.291774:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49400, rc 0) 00000100:00100000:1.0:1788530004.291812:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650560:12345-0@lo:101:mount.lustre.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.291818:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530004.292310:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530004.292328:0:15741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2cb expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530004.292337:0:15741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c2cb expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530004.293310:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000040:00080000:2.0:1788530004.298988:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530004.299325:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788530004.299371:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:2.0:1788530004.299407:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:2.0:1788530004.299454:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:2.0:1788530004.299491:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:2.0:1788530004.299538:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:2.0:1788530004.299571:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:2.0:1788530004.299601:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:2.0:1788530004.299679:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:2.0:1788530004.299713:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:2.0:1788530004.299743:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:2.0:1788530004.299784:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:2.0:1788530004.299815:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:2.0:1788530004.299867:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:2.0:1788530004.299944:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:2.0:1788530004.299982:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:2.0:1788530004.300013:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:2.0:1788530004.300056:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:2.0:1788530004.300087:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:2.0:1788530004.300117:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:2.0:1788530004.300160:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:2.0:1788530004.300192:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:2.0:1788530004.300222:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:2.0:1788530004.300264:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:2.0:1788530004.300313:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 128 off12440 00000040:00080000:2.0:1788530004.300346:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12664 00000040:00080000:2.0:1788530004.300393:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12888 00000040:00080000:2.0:1788530004.300428:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off12968 00000040:00080000:2.0:1788530004.300461:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13192 00000040:00080000:2.0:1788530004.300508:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13416 00000040:00080000:2.0:1788530004.300542:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13504 00000040:00080000:2.0:1788530004.300574:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13632 00000040:00080000:2.0:1788530004.300607:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13776 00000040:00080000:2.0:1788530004.309579:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13904 00000040:00080000:2.0:1788530004.309714:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14128 00000040:00080000:2.0:1788530004.309765:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14352 00000040:00080000:2.0:1788530004.309798:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14432 00000040:00080000:2.0:1788530004.309829:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14656 00000040:00080000:2.0:1788530004.309876:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14880 00000040:00080000:2.0:1788530004.310125:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 120 off15000 00000040:00080000:2.0:1788530004.310252:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 224 off15224 00000040:00080000:2.0:1788530004.310260:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 41 count 42 00000100:00100000:2.0:1788530004.310366:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.310435:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.310521:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.322816:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650688 00000100:00100000:1.0:1788530004.322831:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650688 00000100:00100000:1.0:1788530004.322919:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788530004.322931:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530004.323257:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650688:12345-0@lo:501:mount.lustre.0 Request processed in 329us (12821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.323266:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788530004.323499:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530004.323550:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530004.323719:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.323750:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650816 00000100:00100000:2.0:1788530004.323754:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650816 00000100:00100000:2.0:1788530004.323788:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530004.323795:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530004.324104:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650816:12345-0@lo:503:mount.lustre.0 Request processed in 309us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.324111:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530004.324154:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.324167:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530004.326312:0:15741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530004.326403:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530004.328462:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530004.328538:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf61b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.330964:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185650944 00000100:00100000:1.0:1788530004.330979:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185650944 00000100:00100000:1.0:1788530004.331033:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530004.331044:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530004.331417:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185650944:12345-0@lo:502:mount.lustre.0 Request processed in 373us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.331426:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530004.331491:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185650944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530004.332063:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788530004.332117:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:1.0:1788530004.332148:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:1.0:1788530004.332191:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:1.0:1788530004.332224:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:1.0:1788530004.332268:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:1.0:1788530004.332301:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:1.0:1788530004.332332:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:1.0:1788530004.332379:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:1.0:1788530004.332415:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:1.0:1788530004.332448:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:1.0:1788530004.332508:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:1.0:1788530004.332545:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:1.0:1788530004.332580:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:1.0:1788530004.332670:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:1.0:1788530004.332707:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:1.0:1788530004.332739:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:1.0:1788530004.332782:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:1.0:1788530004.332812:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:1.0:1788530004.332843:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:1.0:1788530004.332889:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:1.0:1788530004.333680:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:1.0:1788530004.333717:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:1.0:1788530004.333767:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:1.0:1788530004.333799:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 128 off12440 00000040:00080000:1.0:1788530004.333830:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12664 00000040:00080000:1.0:1788530004.333877:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12888 00000040:00080000:0.0:1788530004.339839:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off12968 00000040:00080000:0.0:1788530004.340024:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13192 00000040:00080000:0.0:1788530004.340103:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13416 00000040:00080000:0.0:1788530004.340138:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13504 00000040:00080000:0.0:1788530004.340172:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13632 00000040:00080000:0.0:1788530004.340206:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13776 00000040:00080000:0.0:1788530004.340255:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13904 00000040:00080000:0.0:1788530004.340292:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14128 00000040:00080000:0.0:1788530004.340340:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14352 00000040:00080000:0.0:1788530004.340377:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14432 00000040:00080000:0.0:1788530004.340412:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14656 00000040:00080000:0.0:1788530004.343883:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14880 00000040:00080000:0.0:1788530004.344021:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 120 off15000 00000100:00100000:0.0:1788530004.344076:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185651072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530004.344175:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530004.344220:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc2df7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.344389:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651072 00000100:00100000:1.0:1788530004.344397:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651072 00000100:00100000:1.0:1788530004.344446:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788530004.344456:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185651072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530004.344713:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185651072:12345-0@lo:502:mount.lustre.0 Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.344722:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788530004.344942:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185651072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530004.345020:0:15741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 224 off15224 00000040:00080000:0.0:1788530004.345030:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788530004.352060:0:15751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788530004.352079:0:15751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cabc3ece620) 00000020:00000080:0.0:1788530004.352104:0:15751:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788530004.352175:0:15751:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8caac43f2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530004.352180:0:15751:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8caac43f2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530004.352183:0:15751:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8caac43f2800 3 00010000:00080000:0.0:1788530004.352210:0:15751:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cabfc75f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1788530004.358651:0:15751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788530004.359295:0:15751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788530004.359336:0:15751:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530004.359350:0:15751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa46022e3f18c2d9 00000100:00080000:0.0:1788530004.359361:0:15751:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530004.359367:0:15751:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cabfc75f000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1788530004.359405:0:15751:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8caac779c000 x1875409185651200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530004.359435:0:15751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788530004.363195:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185651200:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788530004.363282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530004.363399:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530004.363404:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530004.363408:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530004.363415:0:12190:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:3.0:1788530004.363419:0:12190:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788530004.363426:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1788530004.363451:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc132300 x1875409185651456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530004.363515:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.363545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530004.363571:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530004.363576:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.363609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530004.363648:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185651456:0@lo:8:kworker.0 00000100:00100000:3.0:1788530004.363670:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530004.363699:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185651712:0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.363721:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530004.363759:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651328 00000100:00100000:3.0:1788530004.363767:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651328 00000100:00100000:3.0:1788530004.363836:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651456 00000100:00100000:3.0:1788530004.363840:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651456 00000100:00100000:3.0:1788530004.363852:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530004.363862:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185651328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.363942:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185651328:12345-0@lo:400:kworker.0 Request processed in 81us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.363949:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530004.363967:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530004.363972:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185651456:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788530004.364017:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875409185651456:12345-0@lo:8:kworker.0 Request processed in 44us (346us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788530004.364024:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530004.364043:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651200 00000100:00100000:3.0:1788530004.364046:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651200 00000100:00100000:3.0:1788530004.364057:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651584 00000100:00100000:3.0:1788530004.364058:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651584 00000100:00100000:3.0:1788530004.364070:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651712 00000100:00100000:3.0:1788530004.364072:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651712 00000100:00100000:3.0:1788530004.364086:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530004.364092:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.364120:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185651584:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.364127:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530004.364138:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530004.364143:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185651712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.364169:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185651712:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.364175:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530004.364195:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530004.364199:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875409185651200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788530004.364214:0:14341:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788530004.364249:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa46022e3f18c2e0 00000004:00100000:3.0:1788530004.364266:0:14341:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788530004.364295:0:14341:0:(import.c:65:import_set_state_nolock()) ffff8cabcf4d9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530004.364326:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875409185651200:12345-0@lo:38:llog_process_th.0 Request processed in 126us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530004.364332:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788530004.364355:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530004.364359:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530004.364381:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfc133480 x1875409185651584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530004.364394:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.364405:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788530004.364429:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530004.364435:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530004.364439:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788530004.364442:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185651456:0@lo:8:kworker.0 00010000:00080000:3.0:1788530004.364453:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8caac779c000 x1875409185651200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530004.364461:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530004.364465:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788530004.364472:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788530004.364476:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788530004.364486:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabfc75f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788530004.364491:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875409185651200:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788530004.364518:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cabfc130e00 x1875409185651712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530004.364527:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185651712:0@lo:400:kworker.0 00000040:00080000:1.0:1788530004.367565:0:15751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 42 count 42 00000020:01000000:0.0:1788530004.367942:0:15741:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788530004.367957:0:15741:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530004.367975:0:15741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2cb expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530004.368001:0:15741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc5100a00/0xaa46022e3f18c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2cb expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788530004.368048:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788530004.368050:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530004.368052:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530004.368053:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530004.368067:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530004.368068:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530004.368070:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530004.368072:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530004.368073:0:15741:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530004.368077:0:15741:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788530004.368079:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530004.368081:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530004.368082:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530004.368083:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530004.368085:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530004.368086:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530004.368088:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530004.368089:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530004.368090:0:15741:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530004.368115:0:15741:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788530004.368133:0:15741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185651840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788530004.368198:0:15741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530004.368235:0:15741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc9482300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530004.368327:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651840 00000100:00100000:2.0:1788530004.368335:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651840 00000100:00100000:2.0:1788530004.368384:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530004.368393:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:15741:x1875409185651840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788530004.368419:0:14334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788530004.368433:0:14334:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788530004.444149:0:14334:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788530004.444174:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788530004.444275:0:14355:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788530004.444280:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788530004.444310:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444334:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 23 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444342:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 23 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444349:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444356:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444409:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444432:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 23 pid: 14331 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.444448:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185651968:0@lo:104: 00000100:00100000:1.0:1788530004.444529:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530004.444593:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 23 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444629:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 23 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.444653:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185652096:0@lo:104: 00000100:00100000:1.0:1788530004.444684:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530004.444717:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 23 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.444725:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 23 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.444738:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185652224:0@lo:104: 00000100:00100000:1.0:1788530004.444770:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.444781:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1f56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530004.444813:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788530004.444825:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185651968 00000100:00100000:1.0:1788530004.444837:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185651968 00000100:00100000:1.0:1788530004.444884:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652096 00000100:00100000:1.0:1788530004.444888:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652096 00000100:00100000:1.0:1788530004.444933:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652224 00000100:00100000:1.0:1788530004.444936:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652224 00000100:00100000:1.0:1788530004.444957:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530004.444971:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:14355:x1875409185651968:12345-0@lo:104: 00010000:00010000:1.0:1788530004.444986:0:14322:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445047:0:14322:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530004.445053:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+5:14355:x1875409185651968:12345-0@lo:104: Request processed in 88us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.445072:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530004.445096:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530004.445102:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:14355:x1875409185652096:12345-0@lo:104: 00010000:00010000:1.0:1788530004.445110:0:14322:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445167:0:14322:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530004.445179:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:14355:x1875409185652096:12345-0@lo:104: Request processed in 71us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.445186:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530004.445198:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530004.445209:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185652224:12345-0@lo:104: 00010000:00010000:1.0:1788530004.445217:0:14322:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445248:0:14322:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788530004.445253:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:14355:x1875409185652224:12345-0@lo:104: Request processed in 50us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.445259:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788530004.445308:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530004.445314:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445321:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530004.445325:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445350:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530004.445357:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530004.445370:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530004.445404:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445411:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530004.445438:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445445:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc5100200/0xaa46022e3f18c2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2af expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445464:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530004.445467:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445473:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530004.445476:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445482:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530004.445489:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530004.445507:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530004.445521:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445527:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530004.445545:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445552:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabcfc49a00/0xaa46022e3f18c197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c19e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445563:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530004.445568:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445574:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5100400 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530004.445577:0:14328:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445585:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530004.445592:0:14328:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530004.445598:0:14328:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530004.445609:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445615:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530004.445627:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445634:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc5100400/0xaa46022e3f18c189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c190 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.445659:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530004.445661:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530004.445663:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530004.445670:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530004.445691:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185652352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530004.445720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.445754:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185652480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530004.445775:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.445790:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530004.445795:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185652608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530004.445815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530004.445840:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652352 00000100:00100000:1.0:1788530004.445844:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652352 00010000:00010000:1.0:1788530004.445864:0:14324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 24 pid: 14331 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.445883:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652480 00000100:00100000:1.0:1788530004.445886:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652480 00010000:00010000:1.0:1788530004.445930:0:14324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 25 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.445942:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652608 00000100:00100000:1.0:1788530004.445944:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652608 00010000:00010000:1.0:1788530004.445955:0:14324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 26 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.445974:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530004.445981:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+26:3301:x1875409185652352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530004.445991:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530004.445996:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 26 pid: 14331 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446009:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 26 pid: 14331 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446026:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530004.446052:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+26:3301:x1875409185652352:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.446059:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530004.446071:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530004.446076:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+25:3302:x1875409185652480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530004.446084:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530004.446088:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 25 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446097:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 25 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446107:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530004.446127:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+25:3302:x1875409185652480:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.446134:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530004.446144:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530004.446155:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+24:3302:x1875409185652608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530004.446162:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530004.446168:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 24 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446178:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 24 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446189:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446198:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530004.446212:0:14324:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005568522s 00010000:00010000:1.0:1788530004.446216:0:14324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446224:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446232:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446239:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446244:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788530004.446249:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446266:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446275:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446283:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530004.446305:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:686d56f3-22b3-4cb4-96c8-2243e37ce242+24:3302:x1875409185652608:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530004.446311:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530004.446367:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185652352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530004.446390:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185652608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530004.446397:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185652480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530004.446417:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc48800/0xaa46022e3f18c2af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c2a8 expref: 23 pid: 14331 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.446427:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185651968:0@lo:104: 00010000:00010000:1.0:1788530004.446437:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c197 expref: 22 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.446444:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb18700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185652096:0@lo:104: 00010000:00010000:1.0:1788530004.446452:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8caac43d1e00/0xaa46022e3f18c190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c189 expref: 21 pid: 14333 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530004.446459:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14355:1875409185652224:0@lo:104: 00010000:00010000:1.0:1788530004.446473:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446487:0:14355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446494:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530004.446500:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530004.483427:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:15741:x1875409185651840:12345-0@lo:253:mount.lustre.0 Request processed in 115025us (115219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530004.483443:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788530004.483939:0:15741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:686d56f3-22b3-4cb4-96c8-2243e37ce242:15741:1875409185651840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530004.483959:0:15741:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788530004.483963:0:15741:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530004.483964:0:15741:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530004.483966:0:15741:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530004.483967:0:15741:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530004.483969:0:15741:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530004.483986:0:15741:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530004.483988:0:15741:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530004.483990:0:15741:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530004.483991:0:15741:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788530004.484006:0:15741:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788530004.490773:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788530004.490983:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788530004.491139:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788530004.491342:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788530004.491861:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788530004.492133:0:15741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788530004.495528:0:15741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788530004.592334:0:15741:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788530004.592355:0:15741:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788530004.592396:0:15741:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788530004.592429:0:15741:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788530004.942303:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788530005.517035:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530005.517043:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8caac43f2800 from 8 10000000:01000000:3.0:1788530005.517048:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530005.517093:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.517105:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.517117:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530005.517144:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530005.517226:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530005.517281:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530005.517370:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652736 00000100:00100000:1.0:1788530005.517378:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652736 00000100:00100000:1.0:1788530005.517432:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530005.517442:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:14336:x1875409185652736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530005.517457:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530005.517471:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c2ee expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530005.517493:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c2ee expref: 21 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530005.517504:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49200/0xaa46022e3f18c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2ee expref: 21 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530005.517513:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49200, rc 0) 00000100:00100000:1.0:1788530005.517641:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185652736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530005.517649:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788530005.525384:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530005.525417:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.525430:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c2f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530005.525991:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788530005.526056:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530005.526105:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530005.526249:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652864 00000100:00100000:2.0:1788530005.526256:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652864 00000100:00100000:2.0:1788530005.526326:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788530005.526335:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185652864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530005.526355:0:14334:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530005.526371:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530005.526374:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788530005.526460:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185652864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530005.526467:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530005.526679:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530005.526713:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530005.526720:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.526729:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8caac43d1c00/0xaa46022e3f18c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c2f5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530005.526742:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530005.526745:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabc3e16800 from 8 10000000:01000000:3.0:1788530005.526747:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530005.526771:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.526777:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.526785:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530005.526798:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530005.526822:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530005.526990:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530005.532717:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185652992 00000100:00100000:0.0:1788530005.534765:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185652992 00000100:00100000:0.0:1788530005.534836:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530005.534854:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185652992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530005.534871:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530005.534889:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18c303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c2fc expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.534933:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c2fc expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.534945:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0030200/0xaa46022e3f18c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2fc expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.534954:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030200, rc 0) 00000100:00100000:0.0:1788530005.535028:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185652992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530005.535035:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530005.535445:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185652992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530005.535465:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c303 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530005.535475:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c303 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530005.535538:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788530005.535583:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530005.535632:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9db300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530005.536161:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653120 00000100:00100000:3.0:1788530005.536182:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653120 00000100:00100000:3.0:1788530005.536219:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530005.536226:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185653120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530005.536242:0:14333:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530005.536256:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530005.536259:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788530005.536520:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185653120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 294us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530005.536528:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788530005.537248:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530005.544821:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530005.544840:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c303 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.544989:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8caac43d0800/0xaa46022e3f18c2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c303 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530005.545009:0:14336:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530005.545011:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff8cabf54e5800 from 8 10000000:01000000:0.0:1788530005.545014:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530005.545050:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.545059:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.545070:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530005.545095:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530005.545161:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530005.547186:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530005.556546:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653248 00000100:00100000:3.0:1788530005.556562:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653248 00000100:00100000:3.0:1788530005.556628:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788530005.556639:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185653248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530005.556658:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530005.556681:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac43d0200/0xaa46022e3f18c311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c30a expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.556711:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac43d0200/0xaa46022e3f18c311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c30a expref: 23 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.556724:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac43d0200/0xaa46022e3f18c311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c30a expref: 23 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.556734:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d0200, rc 0) 00000100:00100000:3.0:1788530005.556810:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185653248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (11648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530005.556817:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530005.557092:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530005.557110:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c311 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.557120:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c311 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530005.557182:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530005.557226:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530005.557268:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf5f7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530005.557283:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653376 00000100:00100000:0.0:1788530005.557286:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653376 00000100:00100000:0.0:1788530005.557312:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530005.557319:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185653376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530005.557333:0:14331:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530005.557350:0:14331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530005.557353:0:14331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788530005.557428:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185653376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530005.557434:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530005.557466:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185653376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530005.557526:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530005.557534:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c311 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530005.557542:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030800/0xaa46022e3f18c30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c311 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530005.965132:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530006.624743:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185653504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530006.624818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530006.625933:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653504 00000100:00100000:3.0:1788530006.625954:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653504 00000100:00100000:3.0:1788530006.626022:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530006.626034:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185653504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530006.626073:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788530006.626151:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185653504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530006.626157:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530006.626209:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185653504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788530006.626473:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788530006.992520:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530008.017831:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.038403:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530009.678135:0:12190:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530009.678142:0:12190:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530009.678146:0:12190:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530009.678158:0:12190:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cabf5662000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1788530009.678242:0:12190:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cabfc255c00 x1875409185653888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530009.678292:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185653760:0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.678357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530009.678415:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530009.678421:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185654016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.678445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530009.678480:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653760 00000100:00100000:2.0:1788530009.678486:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653760 00000100:00100000:2.0:1788530009.678558:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530009.678567:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185653760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.678613:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185653760:12345-0@lo:400:kworker.0 Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530009.678620:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530009.678644:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654016 00000100:00100000:2.0:1788530009.678648:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654016 00000100:00100000:2.0:1788530009.678673:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530009.678680:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185654016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530009.678909:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185654144:0@lo:400:kworker.0 00000100:00100000:1.0:1788530009.679016:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185653632:0@lo:400:kworker.0 00000100:00100000:3.0:1788530009.684279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530009.684357:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185653888:0@lo:8:kworker.0 00000100:00100000:3.0:1788530009.684399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530009.684432:0:14339:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530009.684441:0:14339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788530009.684458:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653888 00000100:00100000:3.0:1788530009.684466:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653888 00000100:00100000:3.0:1788530009.684502:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530009.684509:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875409185653888:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788530009.684538:0:15021:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788530009.684598:0:15021:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa46022e3f18c318 00002000:00100000:3.0:1788530009.684611:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cabcf4df800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788530009.684616:0:15021:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788530009.684619:0:15021:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530009.685111:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788530009.685135:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8cabcf4d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530009.685203:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875409185653888:12345-0@lo:8:kworker.0 Request processed in 693us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530009.685211:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788530009.685322:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc255c00 x1875409185653888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788530009.685339:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788530009.685346:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788530009.685351:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788530009.685354:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cabf5662000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788530009.685368:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788530009.685373:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875409185653888:0@lo:8:kworker.0 00000004:00080000:3.0:1788530009.685423:0:14364:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788530009.685438:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14364:1875409185654528:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788530009.685465:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530009.685483:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1f56300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530009.685494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530009.685502:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185654400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530009.685527:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530009.685567:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654400 00000100:00100000:3.0:1788530009.685571:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654400 00000100:00100000:3.0:1788530009.685609:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530009.685617:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185654400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530009.685639:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788530009.685674:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875409185654400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530009.685680:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788530009.686191:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabf5f3fb80 x1875409185654400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530009.686208:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185654400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530009.686300:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654528 00000100:00100000:3.0:1788530009.686305:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654528 00000100:00100000:3.0:1788530009.686327:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530009.686333:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14364:x1875409185654528:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788530009.693884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530009.693966:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185654272:0@lo:400:kworker.0 00000100:00100000:1.0:1788530009.694013:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788530009.694110:0:14363:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530009.694492:0:14363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 519664597150ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788530009.696480:0:15021:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788530009.696491:0:15021:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788530009.696496:0:15021:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:0.0:1788530009.697291:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185653632 00000100:00100000:0.0:1788530009.697303:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185653632 00000100:00100000:0.0:1788530009.697361:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530009.697370:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3301:x1875409185653632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530009.697456:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3301:x1875409185653632:12345-0@lo:400:kworker.0 Request processed in 86us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530009.697475:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530009.697537:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:686d56f3-22b3-4cb4-96c8-2243e37ce242:3301:1875409185653632:0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.704338:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875409185654016:12345-0@lo:400:kworker.0 Request processed in 25649us (25882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530009.704355:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788530009.704429:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530009.704434:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530009.704456:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654144 00000100:00100000:2.0:1788530009.704465:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654144 00000100:00100000:2.0:1788530009.704503:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654272 00000100:00100000:2.0:1788530009.704505:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654272 00000100:00100000:2.0:1788530009.704520:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530009.704527:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.704607:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185654144:12345-0@lo:400:kworker.0 Request processed in 80us (20336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530009.704614:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530009.704626:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788530009.704632:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.704670:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875409185654272:12345-0@lo:400:kworker.0 Request processed in 39us (10656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530009.704690:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788530009.705354:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc257b80 x1875409185654272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530009.705370:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875409185654272:0@lo:400:kworker.0 00000100:00080000:2.0:1788530009.705969:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788530009.706003:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc255f80 x1875409185654016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530009.706015:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875409185654016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530009.706029:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185653760:0@lo:400:kworker.0 00010000:00080000:3.0:1788530009.711461:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cabfc257800 x1875409185654144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530009.711478:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185654144:0@lo:400:kworker.0 00002000:00010000:3.0:1788530009.712360:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.712369:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712385:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.712390:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.712396:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712413:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712424:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712438:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712458:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.712470:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.712475:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712483:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.712488:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712498:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712514:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712523:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c31f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.712540:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.712541:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.712543:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.714230:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.714248:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714263:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.714268:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.714273:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714286:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714297:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714305:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714326:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.714340:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.714346:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714353:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.714358:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714367:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714387:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714395:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c326 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.714411:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.714413:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.714414:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.715383:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.715393:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.715405:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.715409:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.715414:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.715424:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.715433:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.715441:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.715467:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530009.715802:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530009.715809:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530009.715817:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788530009.715822:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530009.715844:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530009.715859:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530009.715867:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c32d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530009.715885:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530009.715886:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530009.715888:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.721477:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.721491:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721509:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.721514:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.721520:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721535:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721559:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721569:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721587:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.721598:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.721604:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721612:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.721623:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721634:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721650:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721658:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3344a1/0xaa46022e3f18c334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.721678:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.721680:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.721681:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.723322:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.723334:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723349:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.723353:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.723359:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723372:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723382:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723397:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723414:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.723427:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.723432:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723440:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.723445:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723454:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723469:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723477:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23a85b9/0xaa46022e3f18c33b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.723494:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.723496:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.723498:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.725250:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.725270:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.725286:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.725290:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.725296:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.725309:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.725319:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.725327:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.725350:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530009.726824:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.726836:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.726850:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.726855:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.726867:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.726889:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.726917:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c622ba/0xaa46022e3f18c342 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.726941:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.726942:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.726953:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.728117:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.728128:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728142:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.728147:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.728152:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728314:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728335:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728343:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728358:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.728370:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.728375:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728382:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.728386:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728396:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728408:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728416:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0afe345/0xaa46022e3f18c349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.728430:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.728436:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.728438:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.729073:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.729080:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729090:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.729094:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.729098:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729108:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729116:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729124:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729140:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.729149:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.729154:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729161:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.729164:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729184:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729195:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729203:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781e9a0a/0xaa46022e3f18c350 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729216:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.729218:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.729219:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.729561:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.729567:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729576:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.729579:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.729584:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729592:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729600:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729613:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729626:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.729634:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.729637:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729644:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.729647:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729655:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729665:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729673:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000546f3e14/0xaa46022e3f18c357 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.729685:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.729686:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.729687:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.730259:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.730272:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730282:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.730286:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.730290:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730300:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730308:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730315:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730330:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.730338:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.730342:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730349:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.730352:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730360:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730377:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730384:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317cd482/0xaa46022e3f18c35e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.730398:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.730400:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.730401:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.731238:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.731246:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731256:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.731260:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.731265:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731274:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731283:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731291:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731317:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530009.731326:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530009.731330:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731337:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530009.731341:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731349:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731361:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731368:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faceedd5/0xaa46022e3f18c365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.731382:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.731383:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.731385:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.732080:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.732088:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732099:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.732107:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.732112:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732123:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732132:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732140:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732250:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.732640:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.732646:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732655:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.732659:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.732663:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732673:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732681:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.732694:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737496:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.737512:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737527:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.737533:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737555:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737576:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737585:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0296c5c/0xaa46022e3f18c36c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737615:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.737619:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737625:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.737628:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737636:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737654:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.737662:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.737664:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.737666:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.741467:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.741481:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092cd97ff/0xaa46022e3f18c373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.742349:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.744122:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.744136:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.744155:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.745294:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.745308:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.745328:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.745340:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.745349:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.745417:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.746238:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.746246:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.746257:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.746261:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.746265:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.746275:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.746283:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.746291:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.754967:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.754983:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.754998:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.755004:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755016:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755037:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755045:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c59e0d1/0xaa46022e3f18c37a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755087:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.755091:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755106:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.755110:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755119:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755129:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755136:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.755138:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.755140:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.755608:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.755616:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0dc14d/0xaa46022e3f18c381 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.755927:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.756636:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.756646:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.756667:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.756672:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.756679:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.756693:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.756843:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.756852:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.756940:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.757356:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.757363:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.757372:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.757376:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.757380:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.757390:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.757408:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.757416:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758194:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.758205:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758215:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50400 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.758220:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758231:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758248:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758264:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb610cc/0xaa46022e3f18c388 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758284:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.758287:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758294:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.758297:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758305:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758315:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.758322:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.758324:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.758326:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788530009.758589:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788530009.764858:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.764874:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a833936c/0xaa46022e3f18c38f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530009.766345:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.766357:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.766373:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.766378:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.766385:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.766400:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.766410:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.766431:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.767997:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.768011:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.768026:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51800 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.768041:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.768053:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.768075:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.768087:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.768089:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.768091:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.769323:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.769335:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e87e2635/0xaa46022e3f18c396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530009.769988:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.769997:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.770012:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.770017:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.770023:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.770038:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.770048:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.770056:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.771939:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.771955:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.771969:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.771975:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.771987:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.772012:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.772024:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.772036:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.772038:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.776100:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.776116:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f6b4064/0xaa46022e3f18c39d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530009.777024:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.777033:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.777048:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.777052:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.777058:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.777072:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.777083:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.777090:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.778829:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.778841:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.778856:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.778861:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.778873:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.778905:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.778915:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.778917:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.778919:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.779028:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.779036:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053a75845/0xaa46022e3f18c3a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530009.782041:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.782054:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.782071:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.782076:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.782081:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.782096:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.782106:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.782114:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.782982:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.782992:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.783004:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.783008:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.783019:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.783045:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.783055:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.783057:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.783059:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.784295:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.784307:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000291fac3/0xaa46022e3f18c3ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.785297:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.786538:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.786561:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.786591:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.786596:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.786602:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.786617:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.786629:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.786637:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.786656:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.787084:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.787090:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.787099:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.787102:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.787107:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.787117:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.787136:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.787144:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.787157:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530009.787271:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.787278:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787287:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.787292:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787302:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787318:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787327:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000481c6e0e/0xaa46022e3f18c3b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787346:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.787350:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787363:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.787367:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787375:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787385:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.787392:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.787394:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.787396:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.787404:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.787576:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf2c40d/0xaa46022e3f18c3b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530009.787991:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.787997:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788007:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.788010:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.788015:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788025:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788033:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788052:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788067:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.788438:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.788444:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788453:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.788456:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.788460:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788469:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788477:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788485:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.788496:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530009.788791:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.788797:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788805:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51e00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.788810:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788820:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788834:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788848:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011f55047/0xaa46022e3f18c3c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788866:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.788869:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788876:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.788880:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788887:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788922:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788930:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47c790d/0xaa46022e3f18c3c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.788942:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.788943:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.788945:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.788951:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530009.789444:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.789451:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789466:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.789470:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.789474:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789484:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789493:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789501:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789567:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788530009.789974:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788530009.789980:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.789989:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788530009.789992:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530009.789996:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.790005:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.790025:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530009.790033:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794127:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530009.794143:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794301:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.794307:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794320:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794343:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794353:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6419160/0xaa46022e3f18c3ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794382:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530009.794386:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794392:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50200 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530009.794395:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794403:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794414:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530009.794428:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.794430:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.794432:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530009.797755:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530009.797816:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788530009.797830:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fa36e9/0xaa46022e3f18c3d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788530009.798383:0:15021:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788530009.798530:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14364:x1875409185654528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112192us (113060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530009.798541:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530009.801115:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14364:1875409185654528:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788530009.801135:0:14364:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788530009.801440:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14364:1875409185654656:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788530009.801502:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530009.801568:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf0ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530009.801620:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654656 00000100:00100000:2.0:1788530009.801628:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654656 00000100:00100000:2.0:1788530009.801689:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530009.801699:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14364:x1875409185654656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788530009.801745:0:15023:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788530009.822583:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14364:x1875409185654656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20876us (21071us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788530009.822597:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530009.832773:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14364:1875409185654656:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788530009.832799:0:14364:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788530010.064410:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530011.085552:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530011.725253:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530011.725271:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185654784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530011.725327:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530011.725383:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654784 00000100:00100000:1.0:1788530011.725390:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654784 00000100:00100000:1.0:1788530011.725437:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530011.725445:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185654784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530011.725475:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788530011.725542:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185654784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530011.725561:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788530011.725591:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530011.725632:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185654784:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788530011.909970:0:16097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788530012.111244:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530013.140109:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530013.581614:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530014.160650:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530014.682165:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.682443:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384128 00000100:00100000:3.0:1788530014.682454:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384128 00000100:00100000:3.0:1788530014.682514:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1788530014.682522:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875409158384128:12345-192.168.201.52@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788530014.682563:0:14334:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5@192.168.201.52@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788530014.682590:0:14334:0:(genops.c:1385:class_connect()) connect: client 16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5, cookie 0xaa46022e3f18c3dc 00000100:00080000:3.0:1788530014.682747:0:14334:0:(import.c:65:import_set_state_nolock()) ffff8caac43f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530014.682821:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+5:2353:x1875409158384128:12345-192.168.201.52@tcp:250:mount.lustre.0 Request processed in 298us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.682830:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1788530014.719109:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530014.724961:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384256 00000100:00100000:0.0:1788530014.724977:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384256 00000100:00100000:2.0:1788530014.725136:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1788530014.725148:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+5:13772:x1875409158384256:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530014.725164:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530014.725182:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5101e00/0xaa46022e3f18c3e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1159 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.725221:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5101e00/0xaa46022e3f18c3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1159 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.725233:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5101e00/0xaa46022e3f18c3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1159 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.725242:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101e00, rc 0) 00000100:00100000:2.0:1788530014.725509:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+6:13772:x1875409158384256:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 361us (6410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.725516:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1788530014.727672:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530014.727763:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384384 00000100:00100000:0.0:1788530014.727772:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384384 00000100:00100000:0.0:1788530014.727822:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1788530014.727831:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+6:13772:x1875409158384384:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530014.729415:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+6:13772:x1875409158384384:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 283us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530014.729433:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1788530014.732467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.732565:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384512 00000100:00100000:3.0:1788530014.732576:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384512 00000100:00100000:3.0:1788530014.732637:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1788530014.732648:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+6:13772:x1875409158384512:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788530014.732665:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530014.732684:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac4f50200/0xaa46022e3f18c3ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1160 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530014.732712:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac4f50200/0xaa46022e3f18c3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1160 expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530014.732723:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac4f50200/0xaa46022e3f18c3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1160 expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530014.732733:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50200, rc 0) 00000100:00100000:3.0:1788530014.732796:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+7:13772:x1875409158384512:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 150us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.732803:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1788530014.736285:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530014.736844:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384640 00000100:00100000:0.0:1788530014.736855:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384640 00000100:00100000:0.0:1788530014.736948:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:0.0:1788530014.736959:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+7:13772:x1875409158384640:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530014.737413:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13772:x1875409158384640:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 455us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530014.737429:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:0.0:1788530014.744162:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530014.744407:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384768 00000100:00100000:2.0:1788530014.744417:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384768 00000100:00100000:2.0:1788530014.744483:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:2.0:1788530014.744495:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13772:x1875409158384768:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530014.744778:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13772:x1875409158384768:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 284us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.744787:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:2.0:1788530014.755429:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.762187:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158384896 00000100:00100000:3.0:1788530014.762219:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158384896 00000100:00100000:3.0:1788530014.762290:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:3.0:1788530014.762302:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13790:x1875409158384896:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530014.762618:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13790:x1875409158384896:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 318us (7198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.762626:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:3.0:1788530014.776515:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530014.776940:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385024 00000100:00100000:0.0:1788530014.776951:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385024 00000100:00100000:0.0:1788530014.777010:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1788530014.777030:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13790:x1875409158385024:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530014.777303:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13790:x1875409158385024:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 274us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530014.777311:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1788530014.784031:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530014.784715:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385152 00000100:00100000:2.0:1788530014.784733:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385152 00000100:00100000:2.0:1788530014.784815:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1788530014.784827:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+8:13772:x1875409158385152:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530014.784856:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530014.784886:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100e00/0xaa46022e3f18c3f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da118a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.784967:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100e00/0xaa46022e3f18c3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da118a expref: 9 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.784979:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100e00/0xaa46022e3f18c3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da118a expref: 9 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.784989:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100e00, rc 0) 00000100:00100000:2.0:1788530014.785106:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+9:13772:x1875409158385152:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 280us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.785113:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:3.0:1788530014.799452:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.799509:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385280 00000100:00100000:3.0:1788530014.799520:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385280 00000100:00100000:3.0:1788530014.799581:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:3.0:1788530014.799595:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+9:13772:x1875409158385280:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788530014.799625:0:14334:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788530014.799658:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530014.799663:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530014.799666:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788530014.799669:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788530014.800423:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185654912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530014.800492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530014.801928:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185654912 00000100:00100000:0.0:1788530014.801943:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185654912 00000100:00100000:0.0:1788530014.802014:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530014.802024:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185654912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530014.802068:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788530014.802165:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875409185654912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530014.802173:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788530014.802809:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530014.811737:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185655296:0@lo:400:kworker.0 00000100:00100000:0.0:1788530014.811836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530014.811912:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530014.811919:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185655168:0@lo:400:kworker.0 00000100:00100000:0.0:1788530014.811949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530014.811992:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655296 00000100:00100000:0.0:1788530014.812001:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655296 00000100:00100000:0.0:1788530014.814713:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530014.814737:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530014.814841:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185655296:12345-0@lo:400:kworker.0 Request processed in 117us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530014.814849:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788530014.814934:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac779ed80 x1875409185655296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530014.814952:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185655296:0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.815425:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185655424:0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.815482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530014.815532:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185654912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530014.815551:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788530014.815557:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185655040:0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.815582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530014.815607:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.815625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530014.815650:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655424 00000100:00100000:1.0:1788530014.815657:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655424 00000100:00100000:1.0:1788530014.815693:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655552 00000100:00100000:1.0:1788530014.815695:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655552 00000100:00100000:1.0:1788530014.815956:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530014.815964:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185655424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.816007:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875409185655424:12345-0@lo:400:kworker.0 Request processed in 44us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530014.816013:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530014.816029:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530014.816043:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185655552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530014.816066:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185655552:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530014.816072:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530014.816366:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655168 00000100:00100000:3.0:1788530014.816372:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655168 00000100:00100000:3.0:1788530014.816401:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530014.816407:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530014.816446:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185655168:12345-0@lo:400:kworker.0 Request processed in 40us (4497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.816452:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530014.816822:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+9:13772:x1875409158385280:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 17227us (17375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.816832:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:3.0:1788530014.816861:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655040 00000100:00100000:3.0:1788530014.816864:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655040 00000100:00100000:3.0:1788530014.816883:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788530014.816888:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3300:x1875409185655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530014.816932:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3300:x1875409185655040:12345-0@lo:400:kworker.0 Request processed in 44us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.816938:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788530014.821644:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185655168:0@lo:400:kworker.0 00000100:00080000:1.0:1788530014.821967:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530014.821976:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530014.822012:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185655040:0@lo:400:kworker.0 00010000:00080000:1.0:1788530014.822035:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac779ca80 x1875409185655552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530014.822048:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185655552:0@lo:400:kworker.0 00010000:00080000:1.0:1788530014.822062:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8caac779d880 x1875409185655424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530014.822071:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875409185655424:0@lo:400:kworker.0 00000100:00100000:0.0:1788530014.846046:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530014.850716:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385408 00000100:00100000:2.0:1788530014.850735:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385408 00000100:00100000:2.0:1788530014.850806:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:2.0:1788530014.850817:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+9:13772:x1875409158385408:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530014.850833:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530014.850852:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1191 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.850884:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.850928:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530014.850938:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101400, rc 0) 00000100:00100000:2.0:1788530014.851007:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13772:x1875409158385408:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 192us (4975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.851014:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:3.0:1788530014.859472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530014.860956:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385536 00000100:00100000:2.0:1788530014.860973:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385536 00000100:00100000:2.0:1788530014.861051:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:2.0:1788530014.861064:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13772:x1875409158385536:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530014.861419:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13772:x1875409158385536:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 356us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.861440:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1788530014.870855:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.871391:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385664 00000100:00100000:3.0:1788530014.871405:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385664 00000100:00100000:3.0:1788530014.871483:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:3.0:1788530014.871495:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13772:x1875409158385664:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788530014.873592:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13772:x1875409158385664:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 2089us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.873607:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:0.0:1788530014.877594:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.878011:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385792 00000100:00100000:3.0:1788530014.878025:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385792 00000100:00100000:3.0:1788530014.878101:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:3.0:1788530014.878114:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13795:x1875409158385792:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530014.878501:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13795:x1875409158385792:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 388us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.878510:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:1.0:1788530014.881837:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.881982:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158385920 00000100:00100000:3.0:1788530014.881995:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158385920 00000100:00100000:3.0:1788530014.882122:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1788530014.882135:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13795:x1875409158385920:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530014.882484:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13795:x1875409158385920:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 350us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.882493:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:3.0:1788530014.893441:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.893502:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386048 00000100:00100000:3.0:1788530014.893516:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386048 00000100:00100000:3.0:1788530014.893570:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1788530014.893581:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875409158386048:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788530014.893621:0:14341:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from caad2f09-bb44-4f05-bb45-30cb5e9cd0e9@192.168.201.52@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788530014.893680:0:14341:0:(genops.c:1385:class_connect()) connect: client caad2f09-bb44-4f05-bb45-30cb5e9cd0e9, cookie 0xaa46022e3f18c3ff 00000004:00100000:3.0:1788530014.893734:0:14341:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788530014.893742:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788530014.946591:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788530014.946652:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788530014.956929:0:14341:0:(import.c:65:import_set_state_nolock()) ffff8caac651e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530014.957031:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2353:x1875409158386048:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 63448us (63601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530014.957044:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1788530014.960032:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530014.960089:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.960169:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386304 00000100:00100000:3.0:1788530014.960184:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386304 00000100:00080000:1.0:1788530014.960307:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530014.960343:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386176 00000100:00100000:3.0:1788530014.960347:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386176 00000100:00100000:0.0:1788530014.960593:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1788530014.960637:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13772:x1875409158386304:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788530014.960689:0:14340:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788530014.960984:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13772:x1875409158386304:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 372us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.962838:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1788530014.962871:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:0:x1875409158386176:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530014.962928:0:14339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788530014.963015:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:0:x1875409158386176:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 162us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.963024:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1788530014.966581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.966664:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386432 00000100:00100000:3.0:1788530014.966678:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386432 00000100:00100000:3.0:1788530014.966755:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788530014.966768:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13772:x1875409158386432:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788530014.966936:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13772:x1875409158386432:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 169us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.966945:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788530014.970565:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.970614:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.970650:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530014.970701:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386560 00000100:00100000:3.0:1788530014.970713:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386560 00000100:00100000:3.0:1788530014.970755:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386688 00000100:00100000:3.0:1788530014.970758:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386688 00000100:00100000:3.0:1788530014.970775:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788530014.970785:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875409158386560:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788530014.970829:0:15021:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from caad2f09-bb44-4f05-bb45-30cb5e9cd0e9@192.168.201.52@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788530014.970873:0:15021:0:(genops.c:1385:class_connect()) connect: client caad2f09-bb44-4f05-bb45-30cb5e9cd0e9, cookie 0xaa46022e3f18c406 00002000:00100000:3.0:1788530014.970924:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli caad2f09-bb44-4f05-bb45-30cb5e9cd0e9/ffff8caac5c70000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788530014.970961:0:15021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788530014.971433:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788530014.971512:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8cabffe81000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530014.971602:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2353:x1875409158386560:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 816us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.971611:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788530014.971642:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788530014.971647:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875409158386688:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788530014.971667:0:15021:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from caad2f09-bb44-4f05-bb45-30cb5e9cd0e9@192.168.201.52@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788530014.971689:0:15021:0:(genops.c:1385:class_connect()) connect: client caad2f09-bb44-4f05-bb45-30cb5e9cd0e9, cookie 0xaa46022e3f18c40d 00002000:00100000:3.0:1788530014.971702:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli caad2f09-bb44-4f05-bb45-30cb5e9cd0e9/ffff8cabffe84000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788530014.971710:0:15021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788530014.971999:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788530014.972017:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8cabffe87800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530014.972044:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2353:x1875409158386688:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 395us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.972051:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1788530014.972530:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386816 00000100:00100000:2.0:1788530014.972540:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386816 00000100:00100000:2.0:1788530014.972591:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1788530014.972600:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13772:x1875409158386816:12345-192.168.201.52@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788530014.973774:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000004:00080000:2.0:1788530014.974689:0:14342:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2013us 00000004:00200000:3.0:1788530014.991501:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788530014.991677:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13772:x1875409158386816:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 19069us (21117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530014.991765:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788530015.147050:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530015.147193:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158386944 00000100:00100000:2.0:1788530015.147207:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158386944 00000100:00100000:2.0:1788530015.147283:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1788530015.147296:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13816:x1875409158386944:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:2.0:1788530015.147324:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530015.147358:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18c414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da11bb expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147446:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147480:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147498:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530015.147567:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788530015.147571:0:15957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788530015.147618:0:15957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147649:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5100000/0xaa46022e3f18c414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11bb expref: 8 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147670:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11bb expref: 7 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530015.147680:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:2.0:1788530015.147684:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530015.147688:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101600, rc 0) 00000100:00100000:2.0:1788530015.147773:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13816:x1875409158386944:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 479us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530015.147781:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00010000:00010000:1.0:1788530015.181444:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530016.205178:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530016.845247:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185655680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530016.845322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530016.845506:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655680 00000100:00100000:1.0:1788530016.845515:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655680 00000100:00100000:1.0:1788530016.845585:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530016.845594:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185655680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530016.845641:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788530016.845692:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185655680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530016.845700:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530016.845747:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfcb19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185655680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530016.846128:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788530017.229199:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530017.355479:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.355584:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387072 00000100:00100000:2.0:1788530017.355596:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387072 00000100:00100000:2.0:1788530017.355683:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1788530017.355694:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13868:x1875409158387072:12345-192.168.201.52@tcp:41:lfs.0 00000004:00000024:2.0:1788530017.355741:0:14341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788530017.356446:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:13868:x1875409158387072:12345-192.168.201.52@tcp:41:lfs.0 Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.356470:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00080000:1.0:1788530017.356934:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530017.361232:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.363991:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387200 00000100:00100000:0.0:1788530017.364008:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387200 00000100:00100000:0.0:1788530017.364120:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1788530017.364133:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13868:x1875409158387200:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:0.0:1788530017.364162:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788530017.364258:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfcb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13868:x1875409158387200:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 126us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.364279:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00080000:1.0:1788530017.364805:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530017.375584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530017.381271:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387328 00000100:00100000:1.0:1788530017.381286:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387328 00000100:00100000:1.0:1788530017.381482:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1788530017.381494:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13868:x1875409158387328:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:1.0:1788530017.381538:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788530017.381641:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:13868:x1875409158387328:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 149us (6067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530017.381649:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00080000:2.0:1788530017.389440:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530017.667038:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.667395:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387456 00000100:00100000:0.0:1788530017.667414:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387456 00000100:00100000:0.0:1788530017.667540:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:0.0:1788530017.667553:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf3606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+10:13900:x1875409158387456:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788530017.667571:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530017.667591:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18c422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da11c2 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.667623:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18c422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11c2 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.667635:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0031800/0xaa46022e3f18c422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11c2 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.667644:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031800, rc 0) 00000100:00100000:0.0:1788530017.667714:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf3606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+11:13900:x1875409158387456:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 164us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.667721:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:1.0:1788530017.672135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.672387:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387584 00000100:00100000:2.0:1788530017.672397:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387584 00000100:00100000:2.0:1788530017.672466:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:2.0:1788530017.672477:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+11:13900:x1875409158387584:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530017.672863:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+11:13900:x1875409158387584:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 385us (736us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530017.672871:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:1.0:1788530017.690618:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.690796:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387712 00000100:00100000:2.0:1788530017.690807:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387712 00000100:00100000:2.0:1788530017.690928:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:2.0:1788530017.690940:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+11:13900:x1875409158387712:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530017.690959:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530017.690977:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100200/0xaa46022e3f18c429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da11c9 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.691007:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100200/0xaa46022e3f18c429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11c9 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.691017:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100200/0xaa46022e3f18c429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11c9 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.691038:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100200, rc 0) 00000100:00100000:2.0:1788530017.691112:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158387712:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 174us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.691132:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1788530017.700463:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.700627:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387840 00000100:00100000:3.0:1788530017.700647:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387840 00000100:00100000:3.0:1788530017.700754:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:3.0:1788530017.700767:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158387840:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788530017.701118:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158387840:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 354us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530017.701127:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1788530017.711061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.711342:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158387968 00000100:00100000:2.0:1788530017.711356:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158387968 00000100:00100000:2.0:1788530017.711427:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:2.0:1788530017.711438:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158387968:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530017.711832:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158387968:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 394us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.711841:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:1.0:1788530017.718275:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.721692:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388096 00000100:00100000:3.0:1788530017.721709:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388096 00000100:00100000:3.0:1788530017.721781:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:3.0:1788530017.721791:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13907:x1875409158388096:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530017.722108:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13907:x1875409158388096:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 318us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530017.722126:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:1.0:1788530017.760966:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.761176:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388224 00000100:00100000:2.0:1788530017.761190:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388224 00000100:00100000:2.0:1788530017.761254:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:2.0:1788530017.761265:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13907:x1875409158388224:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530017.761697:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13907:x1875409158388224:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 432us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.761707:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:1.0:1788530017.769329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.772585:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388352 00000100:00100000:2.0:1788530017.772600:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388352 00000100:00100000:2.0:1788530017.772681:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:2.0:1788530017.772692:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13900:x1875409158388352:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530017.772724:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530017.772742:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100400/0xaa46022e3f18c430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da11f3 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.772778:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100400/0xaa46022e3f18c430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11f3 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.772807:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100400/0xaa46022e3f18c430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11f3 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530017.772817:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100400, rc 0) 00000100:00100000:2.0:1788530017.772885:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13900:x1875409158388352:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 196us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.772922:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1788530017.791867:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.792350:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388480 00000100:00100000:3.0:1788530017.792363:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388480 00000100:00100000:3.0:1788530017.792457:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1788530017.792468:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabc8970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13900:x1875409158388480:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788530017.792494:0:14333:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788530017.792512:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530017.792517:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530017.792520:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788530017.792523:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788530017.804716:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabc8970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13900:x1875409158388480:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 12238us (12849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.804732:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:1.0:1788530017.812133:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.819600:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388608 00000100:00100000:0.0:1788530017.819618:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388608 00000100:00100000:0.0:1788530017.819696:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:0.0:1788530017.819706:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13900:x1875409158388608:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788530017.819735:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530017.819756:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da11fa expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.819784:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.819796:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530017.819808:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030c00, rc 0) 00000100:00100000:0.0:1788530017.819872:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13900:x1875409158388608:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 167us (7748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.819879:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:1.0:1788530017.822963:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.823073:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388736 00000100:00100000:0.0:1788530017.823084:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388736 00000100:00100000:0.0:1788530017.823144:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:0.0:1788530017.823273:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13900:x1875409158388736:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530017.823691:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13900:x1875409158388736:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 537us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.823700:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:1.0:1788530017.835544:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.836380:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388864 00000100:00100000:2.0:1788530017.836398:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388864 00000100:00100000:2.0:1788530017.836619:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1788530017.836631:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13900:x1875409158388864:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530017.836931:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13900:x1875409158388864:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 301us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.836939:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:3.0:1788530017.839526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.853146:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158388992 00000100:00100000:0.0:1788530017.853232:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158388992 00000100:00100000:0.0:1788530017.853317:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:0.0:1788530017.853328:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13913:x1875409158388992:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530017.856271:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13913:x1875409158388992:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 2933us (16750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530017.856305:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:1.0:1788530017.872664:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.872781:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389120 00000100:00100000:2.0:1788530017.872798:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389120 00000100:00100000:2.0:1788530017.873608:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:2.0:1788530017.873623:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13913:x1875409158389120:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530017.873927:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13913:x1875409158389120:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 306us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.873936:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:1.0:1788530017.910392:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.913388:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389248 00000100:00100000:3.0:1788530017.913412:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389248 00000100:00100000:3.0:1788530017.913477:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1788530017.913486:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1875409158389248:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788530017.913516:0:15957:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from ecd5e1f1-cff6-40b4-87fb-56a1379238b2@192.168.201.52@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1788530017.913559:0:15957:0:(genops.c:1385:class_connect()) connect: client ecd5e1f1-cff6-40b4-87fb-56a1379238b2, cookie 0xaa46022e3f18c43e 00000004:00100000:3.0:1788530017.913588:0:15957:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788530017.913712:0:15957:0:(import.c:65:import_set_state_nolock()) ffff8cabffe82000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530017.913794:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2353:x1875409158389248:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 307us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530017.913802:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:0.0:1788530017.918611:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.918662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.918748:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389504 00000100:00100000:3.0:1788530017.918761:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389504 00000100:00100000:3.0:1788530017.918841:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389376 00000100:00100000:3.0:1788530017.918845:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389376 00000100:00100000:3.0:1788530017.918890:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1788530017.918943:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:13900:x1875409158389504:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530017.918986:0:15957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788530017.919056:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1788530017.919067:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:0:x1875409158389376:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788530017.919080:0:14341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788530017.919130:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530017.928205:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:13900:x1875409158389504:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 9251us (9592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530017.928222:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1788530017.937786:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:0:x1875409158389376:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 18710us (19111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.937801:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1788530017.951166:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530017.951547:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389632 00000100:00100000:2.0:1788530017.951560:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389632 00000100:00100000:2.0:1788530017.951616:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1788530017.951626:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:13900:x1875409158389632:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788530017.951722:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:13900:x1875409158389632:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 98us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530017.951729:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1788530017.966524:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530017.966580:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390016 00000100:00100000:1.0:1788530017.966590:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390016 00000100:00100000:1.0:1788530017.966643:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1788530017.966654:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:13900:x1875409158390016:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788530017.966739:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788530017.966825:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:13900:x1875409158390016:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 172us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530017.966833:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1788530017.967075:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530017.967112:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530017.967424:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389760 00000100:00100000:0.0:1788530017.967430:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389760 00000100:00100000:0.0:1788530017.967466:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158389888 00000100:00100000:0.0:1788530017.967470:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158389888 00000100:00100000:1.0:1788530017.967577:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788530017.967584:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875409158389760:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788530017.967610:0:15022:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from ecd5e1f1-cff6-40b4-87fb-56a1379238b2@192.168.201.52@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1788530017.967638:0:15022:0:(genops.c:1385:class_connect()) connect: client ecd5e1f1-cff6-40b4-87fb-56a1379238b2, cookie 0xaa46022e3f18c445 00002000:00100000:1.0:1788530017.967651:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ecd5e1f1-cff6-40b4-87fb-56a1379238b2/ffff8caac6c7e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530017.967663:0:15022:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530017.967864:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530017.967918:0:15022:0:(import.c:65:import_set_state_nolock()) ffff8caac6c79000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530017.967960:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2353:x1875409158389760:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 375us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530017.967968:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788530017.975254:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1788530017.975266:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875409158389888:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788530017.975304:0:15021:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from ecd5e1f1-cff6-40b4-87fb-56a1379238b2@192.168.201.52@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1788530017.975340:0:15021:0:(genops.c:1385:class_connect()) connect: client ecd5e1f1-cff6-40b4-87fb-56a1379238b2, cookie 0xaa46022e3f18c44c 00002000:00100000:1.0:1788530017.975353:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ecd5e1f1-cff6-40b4-87fb-56a1379238b2/ffff8caac6c7c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530017.975366:0:15021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530017.975518:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788530017.975563:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8caac6c7b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530017.975651:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2353:x1875409158389888:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 384us (8538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530017.975659:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000001:00100000:0.0:1788530018.025978:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of caad2f09-bb44-4f05-bb45-30cb5e9cd0e9 00000100:00100000:3.0:1788530018.250289:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530018.250530:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390144 00000100:00100000:0.0:1788530018.250545:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390144 00000100:00100000:0.0:1788530018.250639:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1788530018.250652:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:13934:x1875409158390144:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:0.0:1788530018.250680:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530018.250710:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1224 expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.250802:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.250819:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.250836:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530018.250933:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788530018.250938:0:15957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788530018.250965:0:15957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.251019:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 8 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.251044:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 7 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530018.251055:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:0.0:1788530018.251058:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530018.251063:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030000, rc 0) 00000100:00100000:0.0:1788530018.251165:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:13934:x1875409158390144:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 514us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530018.251174:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00010000:00010000:2.0:1788530018.253112:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530019.291855:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530019.919101:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185655808:0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530019.919269:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185656320:0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530019.919325:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530019.919332:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185656192:0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530019.919406:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656320 00000100:00100000:0.0:1788530019.919414:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656320 00000100:00100000:0.0:1788530019.919467:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656192 00000100:00100000:0.0:1788530019.919470:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656192 00000100:00100000:0.0:1788530019.919493:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530019.919501:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185656320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919557:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185656320:12345-0@lo:400:kworker.0 Request processed in 57us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530019.919580:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530019.919599:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530019.919606:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185656192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919635:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185656192:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530019.919640:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788530019.919660:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530019.919696:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185656192:0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.919709:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185656320:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.921486:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.921588:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530019.921649:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185656448:0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.921678:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655936 00000100:00100000:1.0:1788530019.921690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530019.921698:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655936 00000100:00100000:1.0:1788530019.921756:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530019.921767:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185656064:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.921802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530019.922032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185656576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530019.922068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530019.922125:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656576 00000100:00100000:3.0:1788530019.922132:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656576 00000100:00100000:3.0:1788530019.922493:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530019.922506:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185656576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530019.922550:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788530019.922606:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185656576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530019.922613:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530019.923344:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788530019.923384:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185656576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530019.924377:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656064 00000100:00100000:0.0:1788530019.924394:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656064 00000100:00100000:1.0:1788530019.925136:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185655808 00000100:00100000:1.0:1788530019.925147:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185655808 00000100:00100000:1.0:1788530019.925226:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530019.925240:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185655808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.925325:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185655808:12345-0@lo:400:kworker.0 Request processed in 90us (6132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530019.925344:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530019.925405:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530019.925418:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185655936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.925464:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185655936:12345-0@lo:400:kworker.0 Request processed in 51us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530019.925470:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788530019.927525:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530019.927536:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530019.927636:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530019.927647:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185656064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.927747:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185656064:12345-0@lo:400:kworker.0 Request processed in 103us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530019.927756:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530019.928247:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656448 00000100:00100000:0.0:1788530019.928257:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656448 00000100:00100000:0.0:1788530019.928301:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530019.928308:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185656448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530019.928349:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185656448:12345-0@lo:400:kworker.0 Request processed in 42us (6664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530019.928382:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788530019.928402:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530019.928433:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185655808:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.932726:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185656064:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.932747:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788530019.932761:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185656448:0@lo:400:kworker.0 00000001:00100000:1.0:1788530019.992584:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of caad2f09-bb44-4f05-bb45-30cb5e9cd0e9 00000001:00100000:1.0:1788530019.992622:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ecd5e1f1-cff6-40b4-87fb-56a1379238b2 00000001:00100000:1.0:1788530019.993321:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ecd5e1f1-cff6-40b4-87fb-56a1379238b2 00000001:00100000:1.0:1788530019.993331:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of caad2f09-bb44-4f05-bb45-30cb5e9cd0e9 00010000:00010000:2.0:1788530020.303150:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530021.326487:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788530021.705046:0:16304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788530021.965125:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185656704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530021.965204:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530021.965400:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656704 00000100:00100000:1.0:1788530021.965409:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656704 00000100:00100000:1.0:1788530021.965491:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530021.965502:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185656704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530021.965547:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788530021.965603:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875409185656704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530021.965625:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530021.965689:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875409185656704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530021.965746:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788530022.349272:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788530023.074929:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ecd5e1f1-cff6-40b4-87fb-56a1379238b2 00000100:00100000:3.0:1788530023.193484:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193558:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193575:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193630:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193656:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530023.193678:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390528 00000100:00100000:3.0:1788530023.193689:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390528 00000100:00100000:3.0:1788530023.193755:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391040 00000100:00100000:3.0:1788530023.193758:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391040 00000100:00100000:3.0:1788530023.193774:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390656 00000100:00100000:3.0:1788530023.193776:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390656 00000100:00100000:3.0:1788530023.193787:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390912 00000100:00100000:3.0:1788530023.193790:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390912 00000100:00100000:3.0:1788530023.193804:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1788530023.193814:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158390528:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788530023.193853:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788530023.193863:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788530023.193880:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530023.193884:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530023.193887:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158390528:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530023.193910:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1788530023.194000:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788530023.194008:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158391040:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788530023.194115:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158391040:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 107us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530023.194123:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1788530023.194136:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1788530023.194143:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158390656:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788530023.194165:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158390656:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530023.194172:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1788530023.194193:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1788530023.194199:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158390912:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1788530023.194223:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158390912:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530023.194228:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1788530023.196385:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390272 00000100:00100000:0.0:1788530023.196403:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390272 00000100:00100000:0.0:1788530023.196470:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:0.0:1788530023.196480:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158390272:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530023.196566:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158390272:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 87us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530023.196574:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:0.0:1788530023.196613:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390784 00000100:00100000:0.0:1788530023.196617:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390784 00000100:00100000:0.0:1788530023.196651:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158390400 00000100:00100000:0.0:1788530023.196654:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158390400 00000100:00100000:0.0:1788530023.196672:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788530023.196678:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158390784:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530023.196719:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158390784:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530023.196725:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788530023.196736:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1788530023.196742:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2355:x1875409158390400:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530023.196765:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2355:x1875409158390400:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530023.196788:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00080000:0.0:1788530023.196819:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788530023.373654:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530023.821696:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530024.398969:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530025.046065:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185656832:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.046136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530025.046179:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185657344:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.046206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530025.046233:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530025.046239:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185657216:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.046260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530025.046301:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657344 00000100:00100000:0.0:1788530025.046308:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657344 00000100:00100000:0.0:1788530025.046358:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657216 00000100:00100000:0.0:1788530025.046361:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657216 00000100:00100000:0.0:1788530025.046379:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530025.046388:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185657344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.046435:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185657344:12345-0@lo:400:kworker.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.046441:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530025.046458:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530025.046464:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185657216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.046490:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875409185657216:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.046501:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530025.046783:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185656960:0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.046818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.046840:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185657472:0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.046859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.046870:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530025.046875:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185657088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.046921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.046950:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656832 00000100:00100000:1.0:1788530025.046954:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656832 00000100:00100000:1.0:1788530025.046983:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530025.046989:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185656832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.047019:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185656832:12345-0@lo:400:kworker.0 Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.047025:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530025.047296:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185656960 00000100:00100000:1.0:1788530025.047300:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185656960 00000100:00100000:1.0:1788530025.047326:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657088 00000100:00100000:1.0:1788530025.047328:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657088 00000100:00100000:1.0:1788530025.047347:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530025.047353:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185656960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.047387:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185656960:12345-0@lo:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.047392:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530025.047408:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530025.047412:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185657088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.047435:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185657088:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.047440:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530025.047479:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185657088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.047488:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185656960:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.048413:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657472 00000100:00100000:0.0:1788530025.048423:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657472 00000100:00100000:0.0:1788530025.048454:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788530025.048467:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185657472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.048524:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875409185657472:12345-0@lo:400:kworker.0 Request processed in 59us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.048531:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788530025.048555:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530025.048560:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530025.048563:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530025.048599:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875409185657216:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.048609:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185656832:0@lo:400:kworker.0 00000100:00100000:0.0:1788530025.048619:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185657344:0@lo:400:kworker.0 00000100:00100000:1.0:1788530025.048847:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875409185657472:0@lo:400:kworker.0 00000100:00100000:2.0:1788530025.051556:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530025.051578:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185657600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530025.051648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.051700:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657600 00000100:00100000:2.0:1788530025.051707:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657600 00000100:00100000:2.0:1788530025.051754:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530025.051762:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185657600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530025.051797:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788530025.051848:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185657600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530025.051856:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530025.051934:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185657600:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788530025.374638:0:16454:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbd72b320 20000000:00000080:2.0:1788530025.374657:0:16454:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8caac6c36400 uarg=0000000000000000 20000000:01000000:2.0:1788530025.374706:0:16454:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788530025.374712:0:16454:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788530025.374716:0:16454:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788530025.379831:0:16455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788530025.381152:0:16454:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788530025.395638:0:16454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788530025.395739:0:16454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395763:0:16454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 22 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395771:0:16454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395779:0:16454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395790:0:16454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395797:0:16454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 13 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395804:0:16454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395874:0:16454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 13 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.395960:0:16454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 13 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.395976:0:16454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657728:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530025.396171:0:16454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.396181:0:16454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.396189:0:16454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657856:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530025.396221:0:16454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.396229:0:16454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.396238:0:16454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657984:0@lo:104: 00000100:00100000:1.0:1788530025.396286:0:16454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530025.396323:0:16454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.396331:0:16454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 22 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.396363:0:16454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185658112:0@lo:104: 00000100:00100000:0.0:1788530025.396388:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185657984 00000100:00100000:0.0:1788530025.396397:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185657984 00000100:00100000:1.0:1788530025.396402:0:16454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530025.396430:0:16454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 22 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.396440:0:16454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 22 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530025.396444:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658112 00000100:00100000:0.0:1788530025.396449:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658112 00000100:00100000:1.0:1788530025.396451:0:16454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185658240:0@lo:104: 00000100:00100000:0.0:1788530025.396470:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530025.396476:0:16454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530025.396484:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:16454:x1875409185657984:12345-0@lo:104: 00000100:00100000:1.0:1788530025.396489:0:16454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc50fd240 going to sleep for 11 seconds 00010000:00010000:0.0:1788530025.396499:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530025.396595:0:14322:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788530025.396604:0:14322:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788530025.397142:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530025.397150:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:16454:x1875409185657984:12345-0@lo:104: Request processed in 671us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.397159:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530025.397179:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658240 00000100:00100000:1.0:1788530025.397183:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658240 00000100:00100000:1.0:1788530025.397203:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530025.397210:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:16454:x1875409185658112:12345-0@lo:104: 00010000:00010000:1.0:1788530025.397219:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397257:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530025.397264:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+4:16454:x1875409185658112:12345-0@lo:104: Request processed in 55us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.397282:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530025.397296:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530025.397312:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:16454:x1875409185658240:12345-0@lo:104: 00010000:00010000:1.0:1788530025.397320:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397350:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788530025.397355:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:686d56f3-22b3-4cb4-96c8-2243e37ce242+3:16454:x1875409185658240:12345-0@lo:104: Request processed in 45us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.397361:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788530025.397380:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530025.397386:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397394:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101000 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530025.397398:0:14327:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397408:0:14327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530025.397417:0:14327:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530025.397423:0:14327:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530025.397452:0:14327:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397458:0:14327:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530025.397478:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397496:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabc5101000/0xaa46022e3f18c2b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c2bd expref: -99 pid: 15741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397509:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530025.397513:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397518:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0a00 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530025.397521:0:14327:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397528:0:14327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530025.397534:0:14327:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530025.397539:0:14327:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530025.397554:0:14327:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397560:0:14327:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530025.397566:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397572:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8caac43d0a00/0xaa46022e3f18c151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c158 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397580:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530025.397589:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397594:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabeff37200 already unused, calling callback (ffffffffc1d93e00) 10000000:00010000:1.0:1788530025.397597:0:14327:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397604:0:14327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530025.397609:0:14327:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530025.397614:0:14327:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530025.397628:0:14327:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397633:0:14327:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530025.397647:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397653:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8cabeff37200/0xaa46022e3f18c0e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa46022e3f18c0ef expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.397668:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530025.397670:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530025.397672:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530025.397684:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185658368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530025.397718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.397749:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530025.397755:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185658496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530025.397784:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.397810:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185658624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530025.397833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530025.397865:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658368 00000100:00100000:1.0:1788530025.397869:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658368 00010000:00010000:1.0:1788530025.397888:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 23 pid: 14333 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.397937:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658496 00000100:00100000:1.0:1788530025.397941:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658496 00010000:00010000:1.0:1788530025.397952:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 24 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.397963:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658624 00000100:00100000:1.0:1788530025.397966:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658624 00010000:00010000:1.0:1788530025.397977:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 25 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.397990:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530025.397996:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+25:3302:x1875409185658368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530025.398006:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530025.398011:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 25 pid: 14333 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398021:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 25 pid: 14333 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398037:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530025.398065:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+25:3302:x1875409185658368:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.398081:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530025.398096:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530025.398102:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+24:3302:x1875409185658496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530025.398110:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530025.398115:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 24 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398124:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 24 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398134:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530025.398156:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+24:3302:x1875409185658496:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.398163:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530025.398174:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530025.398181:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3300:x1875409185658624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530025.398188:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530025.398192:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 23 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398201:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 23 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.398208:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530025.398230:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3300:x1875409185658624:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.398235:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530025.398286:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac779d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:686d56f3-22b3-4cb4-96c8-2243e37ce242:3300:1875409185658624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530025.398324:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185658496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530025.398331:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185658368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530025.398854:0:16454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8caac43d1a00/0xaa46022e3f18c2bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c2b6 expref: 22 pid: 14333 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530025.398867:0:16454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657984:0@lo:104: 00010000:00010000:0.0:1788530025.398877:0:16454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49800/0xaa46022e3f18c158 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c151 expref: 21 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530025.398929:0:16454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185658112:0@lo:104: 00010000:00010000:0.0:1788530025.398943:0:16454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49600/0xaa46022e3f18c0ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa46022e3f18c0e8 expref: 20 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530025.398951:0:16454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185658240:0@lo:104: 00010000:00010000:2.0:1788530025.399759:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530025.401833:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530025.401860:0:16454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657728:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788530025.401868:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530025.401880:0:16454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16454:1875409185657856:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788530025.401934:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391168 00000100:00100000:1.0:1788530025.401941:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391168 00010000:00010000:2.0:1788530025.401957:0:16454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.401976:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.402327:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391296 00000100:00100000:1.0:1788530025.402336:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1788530025.402348:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2354:x1875409158391168:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530025.402365:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530025.402371:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.402380:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391296 00010000:00010000:1.0:1788530025.402386:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402404:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc0030c00/0xaa46022e3f18c437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11fa expref: 14 pid: 14331 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402417:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530025.402467:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2354:x1875409158391168:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 122us (643us total) trans 0 rc 0/0 00010000:00010000:2.0:1788530025.402475:0:15046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 14 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530025.402487:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1788530025.402704:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788530025.402712:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:2354:x1875409158391296:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530025.402730:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530025.402735:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402746:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402756:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabc5101400/0xaa46022e3f18c3f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1191 expref: 13 pid: 14334 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402768:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402777:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402790:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402797:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402804:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402811:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402818:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788530025.402822:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402842:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402859:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.402868:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530025.402926:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:2354:x1875409158391296:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 181us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530025.402934:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00010000:00010000:2.0:1788530025.402978:0:16454:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.403062:0:16454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.403069:0:16454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c461 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530025.425578:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530026.449580:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530026.784795:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530026.784990:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391424 00000100:00100000:1.0:1788530026.785003:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391424 00000100:00100000:1.0:1788530026.785885:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:1.0:1788530026.785928:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+12:13787:x1875409158391424:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530026.785947:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530026.785970:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da122b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.786004:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da122b expref: 13 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.786017:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabcfc49c00/0xaa46022e3f18c468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da122b expref: 13 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.786029:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49c00, rc 0) 00000100:00100000:1.0:1788530026.786098:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391424:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530026.786116:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:3.0:1788530026.795099:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530026.805008:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391552 00000100:00100000:2.0:1788530026.805025:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391552 00000100:00100000:3.0:1788530026.805131:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1788530026.805143:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391552:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530026.805559:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391552:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 416us (10468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530026.805569:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1788530026.816352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530026.816725:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391680 00000100:00100000:3.0:1788530026.816738:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391680 00000100:00100000:3.0:1788530026.816816:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:3.0:1788530026.816826:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391680:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530026.817090:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391680:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 264us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530026.817099:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:2.0:1788530026.837349:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530026.838061:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391808 00000100:00100000:0.0:1788530026.838073:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391808 00000100:00100000:0.0:1788530026.838139:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:0.0:1788530026.838152:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+13:13787:x1875409158391808:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530026.838173:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530026.838194:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc0031000/0xaa46022e3f18c46f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1232 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.838226:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc0031000/0xaa46022e3f18c46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1232 expref: 14 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.838238:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc0031000/0xaa46022e3f18c46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1232 expref: 14 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.838257:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0031000, rc 0) 00000100:00100000:0.0:1788530026.838320:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13787:x1875409158391808:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 171us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.838326:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:0.0:1788530026.851116:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530026.851212:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158391936 00000100:00100000:1.0:1788530026.851226:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158391936 00000100:00100000:1.0:1788530026.851300:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1788530026.851311:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabff1ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13787:x1875409158391936:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530026.851667:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabff1ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13787:x1875409158391936:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 356us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530026.851677:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1788530026.854879:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530026.855000:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392064 00000100:00100000:0.0:1788530026.855010:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392064 00000100:00100000:0.0:1788530026.855071:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:0.0:1788530026.855080:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13787:x1875409158392064:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530026.855295:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:13787:x1875409158392064:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 214us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.855302:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:1.0:1788530027.101178:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185658752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530027.101265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530027.101685:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658752 00000100:00100000:0.0:1788530027.101695:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658752 00000100:00100000:0.0:1788530027.101775:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530027.101787:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185658752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530027.101829:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788530027.101940:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875409185658752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530027.101948:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788530027.102280:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530027.102324:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875409185658752:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788530027.152874:0:14336:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530027.152882:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8caac43f2800 from 10 10000000:01000000:0.0:1788530027.152888:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530027.152955:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.152970:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.152982:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530027.153013:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185658880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530027.153084:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530027.153131:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1362e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530027.167354:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185658880 00000100:00100000:3.0:1788530027.167367:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185658880 00000100:00100000:3.0:1788530027.167539:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788530027.167550:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+20:14336:x1875409185658880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530027.167578:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530027.167600:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac4f50e00/0xaa46022e3f18c47d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c476 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.167631:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac4f50e00/0xaa46022e3f18c47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c476 expref: 21 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.167643:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac4f50e00/0xaa46022e3f18c47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c476 expref: 21 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.167652:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50e00, rc 0) 00000100:00100000:3.0:1788530027.167737:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185658880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (14652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530027.167744:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788530027.167805:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185658880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530027.167822:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c47d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.167832:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c47d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530027.168433:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:3.0:1788530027.169276:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530027.169508:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788530027.169546:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:3.0:1788530027.169583:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:3.0:1788530027.169611:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:3.0:1788530027.169641:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:3.0:1788530027.169679:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:3.0:1788530027.169716:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:3.0:1788530027.169741:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:3.0:1788530027.169804:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788530027.169812:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:3.0:1788530027.169934:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.170008:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.170059:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530027.170085:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659008 00000100:00100000:3.0:1788530027.170091:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659008 00000100:00100000:3.0:1788530027.170124:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788530027.170132:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.183018:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 12874us (12997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530027.183035:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788530027.183108:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.183161:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.183207:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.183237:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530027.183266:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659136 00000100:00100000:3.0:1788530027.183273:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659136 00000100:00100000:3.0:1788530027.183314:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788530027.183322:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.183944:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530027.183951:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788530027.184001:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530027.186151:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530027.186260:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659264:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.186366:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.186653:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.190996:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659264 00000100:00100000:2.0:1788530027.191013:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659264 00000100:00100000:2.0:1788530027.191075:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788530027.191086:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659264:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.191379:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659264:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 295us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.191387:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788530027.198850:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659264:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530027.199192:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1788530027.206037:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:2.0:1788530027.206171:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:2.0:1788530027.206205:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:2.0:1788530027.206237:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:2.0:1788530027.206290:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:2.0:1788530027.206317:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:2.0:1788530027.206344:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:2.0:1788530027.206399:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659392:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.206507:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530027.206551:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc7f55cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530027.206678:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659392 00000100:00100000:3.0:1788530027.206685:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659392 00000100:00100000:3.0:1788530027.206736:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788530027.206747:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659392:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.206991:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659392:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 246us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530027.206999:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788530027.207062:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659392:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530027.207159:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1788530027.207168:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:2.0:1788530027.213316:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 10 00000020:01000000:3.0:1788530027.213512:0:14336:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788530027.213530:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530027.213541:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c47d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.213552:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0031400/0xaa46022e3f18c476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c47d expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530027.213568:0:14336:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788530027.213571:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabc3e16800 from 10 10000000:01000000:3.0:1788530027.213574:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530027.213623:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.213632:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.213643:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530027.213668:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.213737:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.213783:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.213887:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659520 00000100:00100000:2.0:1788530027.213923:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659520 00000100:00100000:2.0:1788530027.213971:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788530027.213980:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+21:14336:x1875409185659520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530027.213993:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530027.214013:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cabc5100000/0xaa46022e3f18c48b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c484 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530027.214038:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cabc5100000/0xaa46022e3f18c48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c484 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530027.214048:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cabc5100000/0xaa46022e3f18c48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c484 expref: 22 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530027.214057:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5100000, rc 0) 00000100:00100000:2.0:1788530027.214096:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.214102:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530027.214264:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530027.214278:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c48b expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.214287:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c48b expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530027.214951:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000040:00080000:3.0:1788530027.215846:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530027.216086:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788530027.216121:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788530027.216156:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788530027.216184:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788530027.216208:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788530027.216261:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788530027.216292:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788530027.216319:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788530027.216369:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788530027.216384:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 9 count 10 00000100:00100000:3.0:1788530027.216466:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.216529:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.216572:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.217631:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659648 00000100:00100000:2.0:1788530027.217642:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659648 00000100:00100000:2.0:1788530027.217698:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788530027.217708:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.218008:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.218016:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788530027.220261:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.220330:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530027.220402:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530027.220481:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfc9df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.222688:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659776 00000100:00100000:2.0:1788530027.222701:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659776 00000100:00100000:2.0:1788530027.222765:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788530027.222776:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.223058:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.223067:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788530027.226064:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc132300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530027.226960:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530027.227086:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6ccb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659904:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530027.227164:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530027.227211:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1362cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.227406:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185659904 00000100:00100000:2.0:1788530027.227422:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185659904 00000100:00100000:2.0:1788530027.227475:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788530027.227485:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659904:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.227686:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185659904:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 202us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.227694:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788530027.227793:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6ccb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185659904:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530027.228059:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1788530027.228111:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788530027.228159:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1788530027.228193:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1788530027.228226:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1788530027.228283:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788530027.228320:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1788530027.228352:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:1.0:1788530027.228390:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660032:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530027.228433:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530027.228475:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabf56e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530027.228630:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660032 00000100:00100000:2.0:1788530027.228636:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660032 00000100:00100000:2.0:1788530027.228668:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788530027.228676:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185660032:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530027.228813:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185660032:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 138us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530027.228820:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788530027.229074:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660032:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530027.229167:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1788530027.229178:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:3.0:1788530027.235080:0:16522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 10 00000020:01000000:0.0:1788530027.235552:0:14336:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788530027.235571:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530027.235583:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c48b expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.235595:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8caac4f51200/0xaa46022e3f18c484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c48b expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530027.235606:0:14336:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530027.235608:0:14336:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff8cabf54e5800 from 10 10000000:01000000:0.0:1788530027.235610:0:14336:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530027.235656:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.235665:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.235676:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530027.235703:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530027.235775:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530027.235819:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1362180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530027.237063:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660160 00000100:00100000:3.0:1788530027.237075:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660160 00000100:00100000:3.0:1788530027.237147:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788530027.237157:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+22:14336:x1875409185660160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530027.237176:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530027.237192:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8caac4f51000/0xaa46022e3f18c499 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa46022e3f18c492 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.237219:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8caac4f51000/0xaa46022e3f18c499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa46022e3f18c492 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.237230:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8caac4f51000/0xaa46022e3f18c499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa46022e3f18c492 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530027.237247:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f51000, rc 0) 00000100:00100000:3.0:1788530027.237323:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185660160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530027.237331:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788530027.237468:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530027.237486:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c499 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530027.237510:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa46022e3f18c499 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530027.237562:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530027.237597:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530027.237638:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530027.237695:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660288 00000100:00100000:0.0:1788530027.237706:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660288 00000100:00100000:0.0:1788530027.237744:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788530027.237751:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185660288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530027.238032:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185660288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530027.238039:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788530027.238231:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530027.238275:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530027.238314:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530027.238343:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530027.238472:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660416 00000100:00100000:0.0:1788530027.238477:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660416 00000100:00100000:0.0:1788530027.238523:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788530027.238531:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185660416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530027.238802:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:14336:x1875409185660416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530027.238811:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788530027.244073:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5fb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:686d56f3-22b3-4cb4-96c8-2243e37ce242:14336:1875409185660416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530027.247822:0:16523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788530027.248482:0:14336:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788530027.248585:0:14336:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530027.248598:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c499 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530027.248610:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8cabc0030400/0xaa46022e3f18c492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa46022e3f18c499 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530027.469249:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530028.320020:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320055:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320081:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320132:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320150:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320195:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530028.320959:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392320 00000100:00100000:0.0:1788530028.320972:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392320 00000100:00100000:0.0:1788530028.321033:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392704 00000100:00100000:0.0:1788530028.321036:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392704 00000100:00100000:0.0:1788530028.321057:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1788530028.321067:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2355:x1875409158392320:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.321143:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2355:x1875409158392320:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 77us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.321151:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1788530028.321169:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1788530028.321175:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158392704:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.321198:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158392704:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.321204:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1788530028.321703:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392576 00000100:00100000:0.0:1788530028.321709:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392576 00000100:00100000:0.0:1788530028.321814:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392832 00000100:00100000:0.0:1788530028.321818:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392832 00000100:00100000:0.0:1788530028.321834:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392448 00000100:00100000:0.0:1788530028.321927:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392448 00000100:00100000:0.0:1788530028.321947:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392960 00000100:00100000:0.0:1788530028.321950:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392960 00000100:00100000:0.0:1788530028.321963:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788530028.321969:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158392576:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.322004:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158392576:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 35us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.322011:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788530028.322034:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1788530028.322039:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158392832:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.322063:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158392832:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 24us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.322069:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1788530028.322078:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1788530028.322085:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158392448:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.322104:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158392448:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 20us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.322110:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1788530028.322119:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1788530028.322125:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158392960:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.322145:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158392960:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 20us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.322151:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1788530028.322174:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158392192 00000100:00100000:0.0:1788530028.322177:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158392192 00000100:00100000:0.0:1788530028.322207:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00080000:3.0:1788530028.323974:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530028.323983:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530028.323987:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530028.324055:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158392192:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530028.324116:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcad25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158392192:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1903us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530028.324126:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00010000:00010000:3.0:1788530028.493154:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530029.517178:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530029.949952:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530029.950063:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393088 00000100:00100000:0.0:1788530029.950075:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393088 00000100:00100000:0.0:1788530029.950155:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1788530029.950167:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:14445:x1875409158393088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530029.950189:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530029.950224:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18c4a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1239 expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950291:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950307:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950319:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950334:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950340:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950346:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950653:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18c4b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950662:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950670:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530029.950705:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788530029.950709:0:15957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788530029.950744:0:15957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950754:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950760:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950765:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950771:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530029.950775:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950782:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950794:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:0.0:1788530029.950811:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530029.950817:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950823:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c4a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950837:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950853:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950858:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950863:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530029.950866:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950872:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950880:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cabc500b000) 00010000:00010000:0.0:1788530029.950882:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530029.950885:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950942:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c4ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950978:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18c4a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1239 expref: 8 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950992:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030e00/0xaa46022e3f18c4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1239 expref: 7 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530029.950999:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc500b300) 00010000:00010000:0.0:1788530029.951001:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530029.951011:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030e00, rc 0) 00000100:00100000:0.0:1788530029.951088:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:14445:x1875409158393088:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 923us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530029.951096:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:0.0:1788530029.962091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530029.962185:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393344 00000100:00100000:3.0:1788530029.962207:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393344 00000100:00100000:3.0:1788530029.962277:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1788530029.962288:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:14445:x1875409158393344:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530029.962308:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530029.962332:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1240 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962407:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962422:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962436:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962486:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962504:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962511:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962863:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50000/0xaa46022e3f18c4d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962873:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50000/0xaa46022e3f18c4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.962879:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50000/0xaa46022e3f18c4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530029.962888:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788530029.963149:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963157:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963164:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963170:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530029.963174:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963181:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963204:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cabc500b300) 00010000:00010000:3.0:1788530029.963208:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530029.963213:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963230:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963244:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963250:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963256:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963261:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530029.963264:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963270:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963278:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cabd5d73900) 00010000:00010000:3.0:1788530029.963281:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530029.963283:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963289:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963832:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1240 expref: 10 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963860:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50000/0xaa46022e3f18c4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1240 expref: 9 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530029.963869:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabd5d73200) 00010000:00010000:3.0:1788530029.963871:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530029.963873:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50000, rc 0) 00000100:00100000:3.0:1788530029.964011:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14445:x1875409158393344:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1725us (1929us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788530029.964019:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1788530029.969112:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530029.969189:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393472 00000100:00100000:0.0:1788530029.969210:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393472 00000100:00100000:0.0:1788530029.969289:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1788530029.969300:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14445:x1875409158393472:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788530029.969413:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14445:x1875409158393472:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 114us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530029.969421:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000040:00080000:1.0:1788530030.030377:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530030.058516:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.058608:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393600 00000100:00100000:3.0:1788530030.058625:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393600 00000100:00100000:3.0:1788530030.058735:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1788530030.058749:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14451:x1875409158393600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788530030.058779:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530030.058807:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1247 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.058942:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.058961:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.058976:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.058993:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059016:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059023:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059279:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059289:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059296:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059303:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.059308:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059317:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059331:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:3.0:1788530030.059335:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.059340:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059347:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c4e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059361:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059374:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059380:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059386:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.059389:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059397:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059405:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cabd5d73900) 00010000:00010000:3.0:1788530030.059408:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.059411:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059417:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c4ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059458:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1247 expref: 10 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059470:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:3.0:1788530030.059472:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.059476:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1247 expref: 10 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.059497:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f51800, rc 0) 00000100:00100000:3.0:1788530030.059582:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14451:x1875409158393600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 836us (1083us total) trans 0 rc 301/301 00000100:00100000:3.0:1788530030.059590:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00080000:1.0:1788530030.060066:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530030.077468:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.077646:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393728 00000100:00100000:3.0:1788530030.077656:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393728 00000100:00100000:3.0:1788530030.077715:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788530030.077726:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14451:x1875409158393728:12345-192.168.201.52@tcp:700:lfs.0 00000100:00100000:3.0:1788530030.077813:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14451:x1875409158393728:12345-192.168.201.52@tcp:700:lfs.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.077824:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1788530030.080187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530030.080323:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158393984 00000100:00100000:2.0:1788530030.080337:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158393984 00000100:00100000:2.0:1788530030.080413:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1788530030.080525:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14451:x1875409158393984:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:2.0:1788530030.080609:0:15957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530030.080643:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c41b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da11bb expref: 9 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.080669:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:2.0:1788530030.080675:0:15957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530030.081367:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.081388:0:15957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 5 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.081406:0:15957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.081461:0:15957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 5 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.081485:0:15957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 5 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530030.081505:0:15957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185660544:192.168.201.52@tcp:104: 00000100:00100000:2.0:1788530030.081622:0:15957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530030.087145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.090401:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158394112 00000100:00100000:0.0:1788530030.090438:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158394112 00010000:00010000:0.0:1788530030.091585:0:15046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 6 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530030.091651:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1788530030.091664:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158394112:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1788530030.091674:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788530030.091688:0:15046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530030.091698:0:15046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 6 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.091721:0:15046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 6 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.091777:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:0.0:1788530030.091783:0:15046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.091795:0:15046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.091805:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.091834:0:15046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530030.091956:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158394112:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 294us (4821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.091966:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00010000:00010000:3.0:1788530030.095243:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c45a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1224 expref: 5 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.095273:0:15957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185660544:192.168.201.52@tcp:104: 00010000:00010000:3.0:1788530030.095306:0:15957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.095317:0:15957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.095323:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.095364:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.095405:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.095418:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530030.098022:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788530030.098046:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098060:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098070:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098078:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.098084:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098095:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098116:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabc8c54400) 00010000:00010000:3.0:1788530030.098120:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.098126:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.098132:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c4f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530030.098174:0:15957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005860146c reply state 00000000ef5068cb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.098184:0:15957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530030.098501:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:14451:x1875409158393984:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 18070us (18320us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788530030.098513:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:2.0:1788530030.106876:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.106934:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.106944:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.106950:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788530030.106956:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.106965:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.106984:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cabd5d73900) 00010000:00010000:2.0:1788530030.107000:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530030.107008:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.107016:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c4fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.157409:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185660800:0@lo:400:kworker.0 00000100:00100000:3.0:1788530030.157512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530030.157604:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185661440:0@lo:400:kworker.0 00000100:00100000:3.0:1788530030.157633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530030.157660:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788530030.157667:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788530030.157698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530030.157734:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185661312:0@lo:400:kworker.0 00000100:00100000:3.0:1788530030.157763:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530030.157887:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660800 00000100:00100000:2.0:1788530030.157924:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660800 00000100:00100000:1.0:1788530030.157940:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788530030.158017:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788530030.158026:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530030.158033:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185660800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530030.158071:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185660928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530030.158116:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530030.158127:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185660800:12345-0@lo:400:kworker.0 Request processed in 98us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530030.158139:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788530030.158157:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530030.158161:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185661056 00000100:00100000:2.0:1788530030.158167:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185661056 00000100:00100000:1.0:1788530030.158169:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185661184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530030.158224:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530030.158232:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530030.158241:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185661056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.160138:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185661440 00000100:00100000:0.0:1788530030.160160:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185661440 00000100:00100000:0.0:1788530030.160360:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185661312 00000100:00100000:0.0:1788530030.160366:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185661312 00000100:00100000:0.0:1788530030.160405:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530030.160418:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185661440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530030.160435:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185661056:12345-0@lo:400:kworker.0 Request processed in 2177us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530030.160450:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530030.160559:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185660800:0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.160599:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875409185661440:12345-0@lo:400:kworker.0 Request processed in 182us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.160610:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788530030.160617:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875409185661440:0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.160704:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530030.160713:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185661312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.160769:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875409185661312:12345-0@lo:400:kworker.0 Request processed in 58us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.160796:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530030.160827:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660672 00000100:00100000:0.0:1788530030.160831:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660672 00000100:00100000:0.0:1788530030.160859:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788530030.160865:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185660672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.160921:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3303:x1875409185660672:12345-0@lo:400:kworker.0 Request processed in 56us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.160928:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788530030.161866:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:686d56f3-22b3-4cb4-96c8-2243e37ce242:3303:1875409185660672:0@lo:400:kworker.0 00000100:00100000:2.0:1788530030.161886:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875409185661312:0@lo:400:kworker.0 00000100:00080000:3.0:1788530030.166177:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530030.166203:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530030.166207:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530030.166243:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185660928 00000100:00100000:3.0:1788530030.166261:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185660928 00000100:00100000:3.0:1788530030.166337:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530030.166349:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185660928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530030.166406:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788530030.166528:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185660928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (8410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.166554:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530030.170282:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185661184 00000100:00100000:0.0:1788530030.170301:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185661184 00000100:00100000:0.0:1788530030.170368:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530030.170380:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185661184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.170562:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185661184:12345-0@lo:400:kworker.0 Request processed in 111us (12267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.170573:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530030.179802:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185661184:0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.179826:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185661056:0@lo:400:kworker.0 00000100:00100000:0.0:1788530030.179851:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185660928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530030.223642:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.224149:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158394240 00000100:00100000:3.0:1788530030.224168:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158394240 00000100:00100000:3.0:1788530030.224257:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1788530030.224271:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14459:x1875409158394240:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:3.0:1788530030.224309:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530030.224341:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da124e expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.224502:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c509 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.224522:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.224537:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530030.224584:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788530030.224589:0:15957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788530030.224640:0:15957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.224671:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da124e expref: 11 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.224693:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50600/0xaa46022e3f18c509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da124e expref: 10 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.225074:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:3.0:1788530030.225078:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530030.225082:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50600, rc 0) 00000100:00100000:2.0:1788530030.225396:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:14459:x1875409158394240:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 1124us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530030.225406:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1788530030.247293:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.247793:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158394368 00000100:00100000:1.0:1788530030.247815:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158394368 00000100:00100000:1.0:1788530030.248001:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1788530030.248013:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:14460:x1875409158394368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1788530030.248041:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530030.248069:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1255 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248449:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18c517 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248469:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18c517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248485:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18c517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530030.248534:0:14339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788530030.248538:0:14339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788530030.248578:0:14339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18c517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248612:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1255 expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248634:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49a00/0xaa46022e3f18c517 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1255 expref: 6 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.248643:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:1.0:1788530030.248647:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530030.248652:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49a00, rc 0) 00000100:00100000:1.0:1788530030.248733:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:14460:x1875409158394368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 721us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530030.248741:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1788530030.259322:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530030.259367:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158394496 00000100:00100000:2.0:1788530030.259380:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158394496 00000100:00100000:2.0:1788530030.259456:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1788530030.259469:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:14460:x1875409158394496:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1788530030.259498:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530030.259526:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18c51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da125c expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259614:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259633:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259647:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259663:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259671:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.259677:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.264513:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.264556:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.264571:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530030.264619:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788530030.264625:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788530030.265122:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265140:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265147:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265155:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265162:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788530030.265167:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265175:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265206:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:2.0:1788530030.265210:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530030.265216:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265507:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101400/0xaa46022e3f18c525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265533:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265539:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265546:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265553:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc5101800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1788530030.265556:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265565:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265577:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cabc8c54500) 00010000:00010000:2.0:1788530030.265582:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530030.265586:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265592:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101800/0xaa46022e3f18c52c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.265662:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101000/0xaa46022e3f18c51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da125c expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.267554:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da125c expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.267565:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc8c54800) 00010000:00010000:2.0:1788530030.267569:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530030.267573:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc5101600, rc 0) 00000100:00100000:2.0:1788530030.267661:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:14460:x1875409158394496:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 8193us (8353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530030.267671:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000001:00080000:0.0:1788530030.270401:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:2.0:1788530030.271041:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.271233:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158394752 00000100:00100000:3.0:1788530030.271249:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158394752 00000100:00100000:3.0:1788530030.271326:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1788530030.271338:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+7:14460:x1875409158394752:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1788530030.271370:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530030.271396:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c53a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1263 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530030.271587:0:14339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788530030.272111:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c53a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1263 expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.272130:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:3.0:1788530030.272134:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530030.272141:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c53a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1263 expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.272157:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50800, rc 0) 00000100:00100000:3.0:1788530030.272307:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+8:14460:x1875409158394752:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 971us (1276us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788530030.272317:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1788530030.276339:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530030.276437:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158395008 00000100:00100000:2.0:1788530030.276453:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158395008 00000100:00100000:2.0:1788530030.276537:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1788530030.276552:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+8:14460:x1875409158395008:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:2.0:1788530030.276628:0:15957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530030.276662:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc5101600/0xaa46022e3f18c533 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da125c expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.276686:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc8c54800) 00010000:00010000:2.0:1788530030.276699:0:15957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530030.276744:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.276761:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530030.276773:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530030.282454:0:15957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d253df1 reply state 000000000cf3c5a0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.282479:0:15957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788530030.282494:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788530030.282645:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+9:14460:x1875409158395008:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 6090us (6314us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788530030.282655:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1788530030.285177:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1788530030.285286:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285318:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285328:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285335:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d0a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.285342:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285353:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285378:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc8c54500) 00010000:00010000:3.0:1788530030.285381:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788530030.285388:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.285395:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0a00/0xaa46022e3f18c548 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.285521:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158395264 00000100:00100000:1.0:1788530030.285536:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158395264 00000100:00100000:1.0:1788530030.285606:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1788530030.285619:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+8:14460:x1875409158395264:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788530030.285987:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+9:14460:x1875409158395264:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 369us (823us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788530030.286003:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1788530030.288980:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.289037:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158395520 00000100:00100000:0.0:1788530030.289052:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158395520 00000100:00100000:0.0:1788530030.289138:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1788530030.289152:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+9:14460:x1875409158395520:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788530030.289206:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.289256:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da126a expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289349:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289363:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289373:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289386:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289391:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289395:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.289729:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788530030.289832:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289841:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289849:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289857:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0031600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530030.289861:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289872:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289884:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:0.0:1788530030.289886:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530030.289918:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289926:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0031600/0xaa46022e3f18c556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289943:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289950:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289956:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289962:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabc0030000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530030.289964:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289969:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289974:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cabc500be00) 00010000:00010000:0.0:1788530030.289976:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530030.289978:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.289989:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030000/0xaa46022e3f18c55d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.290030:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c54f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da126a expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.290039:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:0.0:1788530030.290041:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530030.290043:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030a00/0xaa46022e3f18c54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da126a expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.290050:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabc0030a00, rc 0) 00000100:00100000:0.0:1788530030.290116:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+10:14460:x1875409158395520:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 966us (1152us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788530030.290123:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1788530030.292537:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.292840:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158395648 00000100:00100000:0.0:1788530030.292854:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158395648 00000100:00100000:0.0:1788530030.292961:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1788530030.292975:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+10:14460:x1875409158395648:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788530030.293009:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.293040:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18c56b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1271 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293175:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293199:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293234:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.293267:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788530030.293271:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788530030.293291:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293325:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabc0030c00/0xaa46022e3f18c56b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293347:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.293356:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc500b000) 00010000:00010000:0.0:1788530030.293360:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530030.293364:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfa00, rc 0) 00000100:00100000:0.0:1788530030.293557:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+11:14460:x1875409158395648:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 585us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.293565:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1788530030.302713:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.303281:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158395776 00000100:00100000:1.0:1788530030.303297:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158395776 00000100:00100000:1.0:1788530030.303374:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1788530030.303388:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+11:14460:x1875409158395776:12345-192.168.201.52@tcp:37:lfs.0 00000100:00100000:1.0:1788530030.308213:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+11:14460:x1875409158395776:12345-192.168.201.52@tcp:37:lfs.0 Request processed in 4797us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530030.308233:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1788530030.313131:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.313233:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396032 00000100:00100000:3.0:1788530030.313247:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396032 00000100:00100000:3.0:1788530030.313322:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1788530030.313334:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac49f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+11:14460:x1875409158396032:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1788530030.313752:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac49f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+12:14460:x1875409158396032:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 417us (634us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788530030.313762:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1788530030.349445:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.349591:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396160 00000100:00100000:3.0:1788530030.349624:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396160 00000100:00100000:3.0:1788530030.349750:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1788530030.349764:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+8:14466:x1875409158396160:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1788530030.349791:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530030.349822:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1278 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.349956:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.349975:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.349990:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350009:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350017:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350024:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350410:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c58e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350433:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350442:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530030.350484:0:14339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788530030.350488:0:14339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788530030.350536:0:14339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c58e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350551:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350559:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350566:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350572:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.350578:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350588:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350603:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:3.0:1788530030.350606:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.350612:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350620:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350635:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350654:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350661:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350667:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.350670:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350677:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350685:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cabd5d73b00) 00010000:00010000:3.0:1788530030.350688:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.350691:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350697:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c587 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350734:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1278 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350748:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51800/0xaa46022e3f18c58e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1278 expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.350756:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc500b000) 00010000:00010000:3.0:1788530030.350759:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788530030.350767:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f51800, rc 0) 00000100:00100000:3.0:1788530030.350857:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14466:x1875409158396160:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1096us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.350867:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1788530030.354059:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.354202:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396416 00000100:00100000:1.0:1788530030.354216:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396416 00000100:00100000:1.0:1788530030.354329:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1788530030.354342:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:14466:x1875409158396416:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1788530030.354374:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530030.354405:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c595 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da127f expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.354779:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.354799:0:15957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.354810:0:15957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.354856:0:15957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.354937:0:15957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 11 pid: 14341 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.354957:0:15957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc253480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661568:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788530030.355088:0:15957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788530030.363017:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.363117:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396544 00000100:00100000:3.0:1788530030.363130:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396544 00010000:00010000:3.0:1788530030.363195:0:14324:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 12 pid: 14341 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.363239:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1788530030.363251:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedaf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+12:2355:x1875409158396544:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530030.363274:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530030.363283:0:14324:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 12 pid: 14341 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.363304:0:14324:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 12 pid: 14341 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.363331:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc500b000) 00010000:00010000:3.0:1788530030.363339:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.363351:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.363362:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.363385:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530030.363483:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedaf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+12:2355:x1875409158396544:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 233us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.363492:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:1.0:1788530030.364244:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfa00/0xaa46022e3f18c572 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1271 expref: 11 pid: 14341 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.364268:0:15957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc253480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661568:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530030.364299:0:15957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.364309:0:15957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.364316:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.364346:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.364359:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.364368:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368253:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368289:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368305:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530030.368321:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788530030.368355:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368363:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368371:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368377:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530030.368381:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368389:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368404:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc500b000) 00010000:00010000:1.0:1788530030.368407:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530030.368424:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368432:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c59c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530030.368448:0:15957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003826032e reply state 0000000089619fc0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.368463:0:15957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788530030.368509:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c595 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 12 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368525:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 11 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.368533:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530030.368535:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788530030.368538:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48a00, rc 0) 00000100:00100000:1.0:1788530030.368631:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+12:14466:x1875409158396416:12345-192.168.201.52@tcp:101:bash.0 Request processed in 14291us (14589us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788530030.368640:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00010000:00010000:1.0:1788530030.371637:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371661:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371671:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371679:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530030.371685:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371694:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371749:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cabc3837800) 00010000:00010000:1.0:1788530030.371752:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530030.371759:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.371766:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530030.383668:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.383790:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396672 00000100:00100000:0.0:1788530030.383813:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396672 00000100:00100000:0.0:1788530030.383943:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1788530030.383956:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+11:14466:x1875409158396672:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1788530030.383990:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.384018:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1286 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384145:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384164:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384179:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.384244:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788530030.384249:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788530030.384277:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384291:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384327:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 13 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384350:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.384360:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788530030.384363:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530030.384368:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dec00, rc 0) 00000100:00100000:0.0:1788530030.384451:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+12:14466:x1875409158396672:12345-192.168.201.52@tcp:101:bash.0 Request processed in 497us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.384459:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1788530030.388509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.388685:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158396928 00000100:00100000:1.0:1788530030.388699:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158396928 00000100:00100000:1.0:1788530030.388784:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1788530030.388797:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+12:14466:x1875409158396928:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1788530030.389653:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+13:14466:x1875409158396928:12345-192.168.201.52@tcp:35:bash.0 Request processed in 854us (1156us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788530030.389663:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1788530030.480252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.480440:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158397184 00000100:00100000:0.0:1788530030.480455:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158397184 00000100:00100000:0.0:1788530030.480536:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1788530030.480548:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+13:14476:x1875409158397184:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788530030.480583:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.480618:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da128d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.481059:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788530030.481318:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da128d expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.481339:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cabd5d73d00) 00010000:00010000:0.0:1788530030.481342:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530030.481349:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da128d expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.481369:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de200, rc 0) 00000100:00100000:0.0:1788530030.481445:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:14476:x1875409158397184:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 898us (1210us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788530030.481455:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1788530030.488864:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.490405:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158397440 00000100:00100000:1.0:1788530030.490490:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158397440 00000100:00100000:1.0:1788530030.490627:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1788530030.490641:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:14476:x1875409158397440:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788530030.491036:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+15:14476:x1875409158397440:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 396us (2189us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788530030.491046:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1788530030.526792:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.526965:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158397696 00000100:00100000:0.0:1788530030.526979:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158397696 00000100:00100000:0.0:1788530030.527053:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1788530030.527077:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+15:14479:x1875409158397696:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1788530030.527112:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.527141:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da1294 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.527310:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.527330:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.527346:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.527364:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788530030.527542:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1294 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.527565:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1294 expref: 17 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.527575:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788530030.527578:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530030.527584:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de800, rc 0) 00000100:00100000:0.0:1788530030.527683:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:14479:x1875409158397696:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 618us (907us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788530030.527691:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1788530030.533744:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530030.533791:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.533949:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158397824 00000100:00100000:1.0:1788530030.533963:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158397824 00000100:00100000:1.0:1788530030.534035:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1788530030.534046:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:14479:x1875409158397824:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1788530030.534168:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534197:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534211:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534244:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534252:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534260:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534265:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc49800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530030.534271:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534279:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534291:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530030.534294:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788530030.534299:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.534305:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c5e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.534418:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:14479:x1875409158397824:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 373us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530030.534426:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1788530030.535048:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158397952 00000100:00100000:0.0:1788530030.535055:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158397952 00000100:00100000:0.0:1788530030.535109:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1788530030.535118:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:2355:x1875409158397952:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530030.535132:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530030.535158:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1294 expref: 17 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.535172:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788530030.535176:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530030.535220:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+16:2355:x1875409158397952:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 103us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.535227:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788530030.538740:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.538966:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158398208 00000100:00100000:1.0:1788530030.538980:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158398208 00000100:00100000:1.0:1788530030.539056:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1788530030.539078:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+16:14479:x1875409158398208:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1788530030.539432:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:14479:x1875409158398208:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 356us (706us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788530030.539440:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00010000:00010000:3.0:1788530030.541370:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530030.779452:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.779769:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158398464 00000100:00100000:0.0:1788530030.779783:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158398464 00000100:00100000:0.0:1788530030.779870:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1788530030.779883:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+17:14510:x1875409158398464:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:0.0:1788530030.779946:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.779974:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da129b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.780104:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.780123:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.780137:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530030.780151:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788530030.780367:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de800/0xaa46022e3f18c5f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da129b expref: 20 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.780570:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da129b expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.780582:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788530030.780586:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530030.780590:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61de200, rc 0) 00000100:00100000:0.0:1788530030.780678:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:14510:x1875409158398464:12345-192.168.201.52@tcp:101:cat.0 Request processed in 797us (1240us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788530030.780687:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1788530030.785359:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.785532:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158398720 00000100:00100000:1.0:1788530030.785546:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158398720 00000100:00100000:1.0:1788530030.785617:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1788530030.785630:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:14510:x1875409158398720:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:1.0:1788530030.786160:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:14510:x1875409158398720:12345-192.168.201.52@tcp:35:cat.0 Request processed in 530us (814us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788530030.786169:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1788530030.786717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.787194:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158398848 00000100:00100000:3.0:1788530030.787203:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158398848 00000100:00100000:3.0:1788530030.787266:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1788530030.787275:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:2357:x1875409158398848:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530030.787300:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530030.787331:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61de200/0xaa46022e3f18c5f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da129b expref: 20 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.787354:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530030.787360:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530030.787414:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:2357:x1875409158398848:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 135us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.787422:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1788530030.848950:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.849493:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158399104 00000100:00100000:1.0:1788530030.849510:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158399104 00000100:00100000:1.0:1788530030.849601:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1788530030.849615:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:14515:x1875409158399104:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:1.0:1788530030.849649:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530030.849678:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c605 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12a2 expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850107:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850129:0:15957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850139:0:15957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 20 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850149:0:15957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850211:0:15957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 20 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850234:0:15957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 20 pid: 14340 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.850251:0:15957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc253480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661696:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530030.850393:0:15957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.850405:0:15957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530030.850415:0:15957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661824:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788530030.850458:0:15957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530030.875015:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530030.875057:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.875174:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158399232 00000100:00100000:3.0:1788530030.875202:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158399232 00010000:00010000:3.0:1788530030.875273:0:15046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 21 pid: 14340 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.875328:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158399360 00000100:00100000:3.0:1788530030.875331:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158399360 00010000:00010000:3.0:1788530030.875346:0:15046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 22 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.875417:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788530030.875430:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:2354:x1875409158399232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530030.875451:0:15046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530030.875461:0:15046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 22 pid: 14340 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875487:0:15046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 22 pid: 14340 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875520:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530030.875526:0:15046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875539:0:15046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.875540:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dec00/0xaa46022e3f18c5bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da1286 expref: 22 pid: 14340 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875560:0:15046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530030.875581:0:15957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc253480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661696:192.168.201.52@tcp:104: 00000100:00100000:1.0:1788530030.875603:0:15957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15957:1875409185661824:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530030.875642:0:15957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530030.875652:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:2354:x1875409158399232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 220us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.875665:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788530030.875689:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1788530030.875699:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:2354:x1875409158399360:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530030.875710:0:15046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530030.875716:0:15046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875741:0:15046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875755:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c5aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da127f expref: 20 pid: 15957 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875771:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530030.875775:0:15046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875784:0:15046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875794:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.875826:0:15046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530030.875847:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:2354:x1875409158399360:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 149us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.875854:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00010000:00010000:1.0:1788530030.876668:0:15957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.876688:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530030.876713:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788530030.876932:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49800/0xaa46022e3f18c605 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12a2 expref: 20 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.876960:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48800/0xaa46022e3f18c60c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12a2 expref: 19 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.876969:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530030.876973:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788530030.876976:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48800, rc 0) 00000100:00100000:1.0:1788530030.877051:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:14515:x1875409158399104:12345-192.168.201.52@tcp:101:dd.0 Request processed in 27439us (28120us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788530030.877060:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1788530030.886456:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.886591:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158399616 00000100:00100000:0.0:1788530030.886605:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158399616 00000100:00100000:0.0:1788530030.886683:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1788530030.886696:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+19:14515:x1875409158399616:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:0.0:1788530030.887537:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.887561:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.887575:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530030.887641:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788530030.887675:0:14340:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031c7fd7f reply state 00000000d879449b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530030.887686:0:14340:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530030.888139:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14515:x1875409158399616:12345-192.168.201.52@tcp:36:dd.0 Request processed in 1442us (1697us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788530030.888254:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000020:00080000:0.0:1788530030.888261:0:14340:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788530030.896314:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896341:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896351:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896383:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530030.896391:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896402:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896425:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530030.896428:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530030.896435:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.896441:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dee00/0xaa46022e3f18c61a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530030.896735:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530030.896851:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158399744 00000100:00100000:0.0:1788530030.897030:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158399744 00000100:00100000:0.0:1788530030.897118:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1788530030.897130:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:14515:x1875409158399744:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:0.0:1788530030.897184:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530030.897210:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dea00/0xaa46022e3f18c621 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.897290:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dea00/0xaa46022e3f18c621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12a9 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.897307:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dea00/0xaa46022e3f18c621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12a9 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530030.897330:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:0.0:1788530030.897333:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530030.897337:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dea00, rc 0) 00000100:00100000:0.0:1788530030.897421:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14515:x1875409158399744:12345-192.168.201.52@tcp:101:dd.0 Request processed in 294us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530030.897430:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1788530030.932309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530030.932425:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400000 00000100:00100000:1.0:1788530030.932439:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400000 00000100:00100000:1.0:1788530030.932517:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1788530030.932527:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14515:x1875409158400000:12345-192.168.201.52@tcp:103:dd.0 00010000:00010000:1.0:1788530030.932544:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530030.932572:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dea00/0xaa46022e3f18c621 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12a9 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530030.932590:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530030.932596:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530030.932659:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:14515:x1875409158400000:12345-192.168.201.52@tcp:103:dd.0 Request processed in 134us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530030.932664:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1788530030.934931:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.935014:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400128 00000100:00100000:3.0:1788530030.935028:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400128 00000100:00100000:3.0:1788530030.935099:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1788530030.935111:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:14515:x1875409158400128:12345-192.168.201.52@tcp:58:dd.0 00010000:00010000:3.0:1788530030.935457:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.935479:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.935493:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530030.938525:0:14339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530030.938852:0:14339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788530030.938972:0:14339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788530030.941408:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:14515:x1875409158400128:12345-192.168.201.52@tcp:58:dd.0 Request processed in 4034us (4257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530030.941456:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1788530030.942386:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530030.942524:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400256 00000100:00100000:3.0:1788530030.942537:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400256 00000100:00100000:3.0:1788530030.942613:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1788530030.942625:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+21:14515:x1875409158400256:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:3.0:1788530030.942652:0:15957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530030.942679:0:15957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12b0 expref: -99 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942752:0:15957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942766:0:15957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 22 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942860:0:15957:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942880:0:15957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 22 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942922:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530030.942926:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530030.942930:0:15957:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 22 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530030.942939:0:15957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f50800, rc 0) 00000100:00100000:3.0:1788530030.943020:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14515:x1875409158400256:12345-192.168.201.52@tcp:101:dd.0 Request processed in 397us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530030.943027:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000040:00080000:1.0:1788530031.053344:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788530031.053359:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530031.053574:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788530031.053585:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788530031.053867:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14374:1875409185661952:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788530031.054181:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530031.060112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.060264:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14374:1875409185661952:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530031.060813:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400384 00000100:00100000:3.0:1788530031.060840:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400384 00000100:00100000:3.0:1788530031.060938:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788530031.060952:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400384:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788530031.061075:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400384:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 125us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530031.061085:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1788530031.078264:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.078417:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400512 00000100:00100000:0.0:1788530031.078431:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400512 00000100:00100000:0.0:1788530031.078508:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1788530031.078540:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400512:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530031.078585:0:14340:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530031.078741:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400512:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 203us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.078749:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1788530031.087381:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.087533:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400640 00000100:00100000:3.0:1788530031.087547:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400640 00000100:00100000:3.0:1788530031.087623:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1788530031.087634:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400640:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788530031.087729:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.087747:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.087759:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090068:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090095:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090109:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090141:0:15957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090169:0:15957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090185:0:15957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530031.090234:0:15957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788530031.090239:0:15957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788530031.090253:0:15957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090264:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090271:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.090277:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.091884:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530031.091913:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.091925:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.091943:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabd5d73200) 00010000:00010000:3.0:1788530031.091946:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530031.091951:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.091976:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51600/0xaa46022e3f18c636 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.091997:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092003:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092009:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092014:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530031.092016:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092022:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092029:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cabd5d73b00) 00010000:00010000:3.0:1788530031.092032:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530031.092035:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092041:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51c00/0xaa46022e3f18c63d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092059:0:15957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092064:0:15957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092078:0:15957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092083:0:15957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1788530031.092085:0:15957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092091:0:15957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092098:0:15957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:3.0:1788530031.092101:0:15957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530031.092103:0:15957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.092109:0:15957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f51a00/0xaa46022e3f18c644 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530031.093624:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400640:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 5978us (6246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530031.093640:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1788530031.103141:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.107506:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158400896 00000100:00100000:1.0:1788530031.107527:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158400896 00000100:00100000:1.0:1788530031.109555:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1788530031.109587:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+22:14517:x1875409158400896:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530031.109621:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530031.109670:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c64b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12b7 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.109838:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.109861:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.109878:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530031.109922:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788530031.110068:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110077:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110084:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110090:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.110095:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110104:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110121:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530031.110125:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788530031.110131:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110149:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c652 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110224:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c64b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b7 expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110236:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cabd5d73200) 00010000:00010000:1.0:1788530031.110238:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788530031.110242:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc49600/0xaa46022e3f18c64b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b7 expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.110253:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc49600, rc 0) 00000100:00100000:1.0:1788530031.110352:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+23:14517:x1875409158400896:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 781us (7228us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788530031.110360:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1788530031.116000:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.125057:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158401024 00000100:00100000:0.0:1788530031.125083:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158401024 00000100:00100000:2.0:1788530031.130521:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1788530031.130544:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+23:14517:x1875409158401024:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788530031.130608:0:14341:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788530031.130926:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+23:14517:x1875409158401024:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 386us (14941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530031.130936:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1788530031.158137:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530031.159621:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158401280 00000100:00100000:2.0:1788530031.159640:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158401280 00000100:00100000:2.0:1788530031.159740:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:2.0:1788530031.159752:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+23:14517:x1875409158401280:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530031.159781:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530031.159820:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0600/0xaa46022e3f18c660 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12be expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788530031.164208:0:14339:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1788530031.164237:0:14339:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788530031.164326:0:14339:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788530031.177777:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0400/0xaa46022e3f18c667 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.177807:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0400/0xaa46022e3f18c667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.177835:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0400/0xaa46022e3f18c667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.177964:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0600/0xaa46022e3f18c660 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12be expref: 26 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.177987:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0400/0xaa46022e3f18c667 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12be expref: 25 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.177997:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc8c54800) 00010000:00010000:2.0:1788530031.178000:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530031.178003:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d0400, rc 0) 00000100:00100000:2.0:1788530031.178086:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+25:14517:x1875409158401280:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 18335us (19969us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788530031.178107:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:2.0:1788530031.191091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.191237:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158401536 00000100:00100000:0.0:1788530031.191251:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158401536 00000100:00100000:0.0:1788530031.191320:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1788530031.191329:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+25:14517:x1875409158401536:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.191400:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530031.191436:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d0400/0xaa46022e3f18c667 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12be expref: 25 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191457:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc8c54800) 00010000:00010000:0.0:1788530031.191469:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530031.191499:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191513:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191521:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191532:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191556:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191561:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191640:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191645:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191649:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191654:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530031.191658:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191664:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191670:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cabc500b000) 00010000:00010000:0.0:1788530031.191671:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530031.191674:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191678:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c675 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191684:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191693:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191697:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191700:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530031.191701:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191705:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191709:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xed917cb9 (ffff8cabc500be00) 00010000:00010000:0.0:1788530031.191710:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530031.191711:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.191715:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c67c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed917cb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530031.191802:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+24:14517:x1875409158401536:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 474us (726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530031.191807:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1788530031.199737:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.205092:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158401664 00000100:00100000:1.0:1788530031.205119:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158401664 00000100:00100000:1.0:1788530031.205420:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1788530031.205435:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+24:14517:x1875409158401664:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530031.205466:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530031.205500:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c683 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12c5 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205550:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48c00/0xaa46022e3f18c68a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205570:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48c00/0xaa46022e3f18c68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205609:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48c00/0xaa46022e3f18c68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205752:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48600/0xaa46022e3f18c683 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12c5 expref: 26 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205776:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48c00/0xaa46022e3f18c68a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12c5 expref: 25 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.205797:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788530031.205801:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530031.205806:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabcfc48c00, rc 0) 00000100:00100000:1.0:1788530031.205955:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+25:14517:x1875409158401664:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 523us (6233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.205963:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1788530031.218563:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.219050:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158401920 00000100:00100000:0.0:1788530031.219065:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158401920 00000100:00100000:0.0:1788530031.219265:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1788530031.219279:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+25:14517:x1875409158401920:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.219396:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.219441:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.219457:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530031.220014:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788530031.220027:0:14341:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 541190132425ns, next at 542190129683ns, rc = 0 00000004:00010000:0.0:1788530031.220141:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a55bd90 reply state 00000000591e27d6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530031.220178:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530031.220336:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+27:14517:x1875409158401920:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1056us (1787us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788530031.220344:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00010000:00010000:1.0:1788530031.230256:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230281:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230291:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230298:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.230305:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230340:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230363:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788530031.230366:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788530031.230374:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.230383:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df400/0xaa46022e3f18c691 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.233590:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530031.233702:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402048 00000100:00100000:2.0:1788530031.233716:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402048 00000100:00100000:2.0:1788530031.233835:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1788530031.233848:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+26:14517:x1875409158402048:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530031.233891:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530031.233939:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12cc expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.234036:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 27 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.234414:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 27 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.234447:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:2.0:1788530031.234451:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530031.234456:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac43d1800, rc 0) 00000100:00100000:2.0:1788530031.234540:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+27:14517:x1875409158402048:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 694us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530031.234549:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1788530031.243961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530031.244143:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402176 00000100:00100000:2.0:1788530031.244157:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402176 00000100:00100000:2.0:1788530031.244331:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1788530031.244346:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2354:x1875409158402176:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788530031.244856:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2354:x1875409158402176:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 510us (963us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788530031.244866:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00080000:3.0:1788530031.245141:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530031.248040:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.248378:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402432 00000100:00100000:1.0:1788530031.248392:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402432 00000100:00100000:1.0:1788530031.248487:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1788530031.248500:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+27:14517:x1875409158402432:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788530031.248888:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+28:14517:x1875409158402432:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 389us (861us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788530031.248932:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1788530031.252550:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.252704:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402688 00000100:00100000:3.0:1788530031.252729:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402688 00000100:00100000:3.0:1788530031.252810:0:15957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1788530031.252844:0:15957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+28:14517:x1875409158402688:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530031.253368:0:15957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+28:14517:x1875409158402688:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 525us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530031.253378:0:15957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:1.0:1788530031.259063:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.264751:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402816 00000100:00100000:0.0:1788530031.264773:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402816 00000100:00100000:0.0:1788530031.265201:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1788530031.265217:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+28:14517:x1875409158402816:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.265247:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530031.265276:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c69f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12d3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265580:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265602:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265629:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530031.265680:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788530031.265702:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265736:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c69f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12d3 expref: 30 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265760:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12d3 expref: 29 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.265771:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788530031.265774:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788530031.265779:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cabf61dfc00, rc 0) 00000100:00100000:0.0:1788530031.266331:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+29:14517:x1875409158402816:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1115us (7281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.266343:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1788530031.271355:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.271499:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158402944 00000100:00100000:3.0:1788530031.271512:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158402944 00000100:00100000:3.0:1788530031.271624:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1788530031.271638:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+6:2355:x1875409158402944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530031.271664:0:15022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530031.271692:0:15022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe0af1fb37da12da expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530031.271732:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9acd6f, blocks: 0x1 00010000:00010000:3.0:1788530031.271761:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1788530031.271766:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530031.271778:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 7 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.271815:0:15022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 7 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.271832:0:15022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8caac4f51a00, rc 0) 00000100:00100000:3.0:1788530031.271959:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:2355:x1875409158402944:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 324us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530031.271968:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1788530031.276721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.276821:0:15957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403200 00000100:00100000:3.0:1788530031.276834:0:15957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403200 00000100:00100000:0.0:1788530031.277038:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1788530031.277055:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+29:14517:x1875409158403200:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788530031.277219:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+29:14517:x1875409158403200:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 169us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.277228:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1788530031.285982:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530031.286098:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403328 00000100:00100000:2.0:1788530031.286114:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403328 00000100:00100000:2.0:1788530031.286201:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1788530031.286215:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+29:14517:x1875409158403328:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788530031.332565:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1788530031.332586:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788530031.332644:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788530031.332651:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788530031.332687:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788530031.333100:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185662080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788530031.333205:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530031.333741:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185662080 00000100:00100000:3.0:1788530031.333752:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185662080 00000100:00100000:3.0:1788530031.333827:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530031.333838:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185662080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788530031.334246:0:15023:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788530031.334251:0:15023:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788530031.334253:0:15023:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788530031.334255:0:15023:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788530031 -> 1788530031 00002000:00010000:3.0:1788530031.334258:0:15023:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788530031.334327:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875409185662080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 489us (1121us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788530031.334336:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788530031.334447:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cabfc721c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788530031.334455:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185662080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788530031.334773:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:14517:x1875409158403328:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 48558us (48808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.337022:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1788530031.338008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.338097:0:16351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403456 00000100:00100000:0.0:1788530031.338110:0:16351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403456 00000100:00100000:0.0:1788530031.338183:0:16351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1788530031.338195:0:16351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:2354:x1875409158403456:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788530031.338425:0:16351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:2354:x1875409158403456:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 231us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.338433:0:16351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1788530031.344009:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.344110:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403712 00000100:00100000:0.0:1788530031.344125:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403712 00000100:00100000:0.0:1788530031.344231:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1788530031.344243:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:14517:x1875409158403712:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.344320:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530031.344357:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfc00/0xaa46022e3f18c6a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12d3 expref: 14 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.344380:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788530031.344387:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530031.344491:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.344510:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.344522:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530031.345146:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bfd8b80 reply state 00000000eca7def6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530031.345159:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530031.345314:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+15:14517:x1875409158403712:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1070us (1545us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788530031.345321:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00010000:00010000:0.0:1788530031.347644:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347665:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347675:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347682:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1788530031.347689:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347698:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347719:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:0.0:1788530031.347723:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530031.347729:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.347735:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61dfe00/0xaa46022e3f18c6b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530031.348328:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.348535:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403840 00000100:00100000:0.0:1788530031.348548:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403840 00000100:00100000:0.0:1788530031.348611:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1788530031.348622:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:2354:x1875409158403840:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788530031.348965:0:15021:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788530031.348970:0:15021:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788530030 00002000:00010000:0.0:1788530031.348973:0:15021:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788530030 00002000:00010000:0.0:1788530031.348975:0:15021:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788530031 -> 1788530030 00002000:00010000:0.0:1788530031.348977:0:15021:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788530031.349049:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+8:2354:x1875409158403840:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 428us (727us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788530031.349058:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1788530031.352223:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.352331:0:16351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158403968 00000100:00100000:0.0:1788530031.352345:0:16351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158403968 00000100:00100000:0.0:1788530031.352495:0:16351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1788530031.352506:0:16351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+8:2354:x1875409158403968:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.352566:0:16351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352586:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530031.352591:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530031.352598:0:16351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352615:0:16351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352671:0:16351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352681:0:16351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352691:0:16351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352699:0:16351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788530031.352704:0:16351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352714:0:16351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352732:0:16351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.352741:0:16351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c6bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530031.352842:0:16351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+8:2354:x1875409158403968:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 338us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530031.352860:0:16351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1788530031.355293:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.355393:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404224 00000100:00100000:0.0:1788530031.355472:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404224 00000100:00100000:0.0:1788530031.355589:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1788530031.355602:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:14517:x1875409158404224:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788530031.355713:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.355734:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.355748:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.356266:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.356282:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 15 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.356291:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.356335:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 15 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.356356:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 15 pid: 14339 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530031.356387:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14340:1875409185662208:192.168.201.52@tcp:104: 00000100:00100000:0.0:1788530031.356563:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabd1f56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530031.361053:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530031.361197:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14340:1875409185662208:192.168.201.52@tcp:104: 00010000:00010000:0.0:1788530031.361236:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.361288:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404352 00000100:00100000:1.0:1788530031.361298:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404352 00010000:00010000:1.0:1788530031.361350:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 16 pid: 14339 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.361466:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1788530031.361478:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+16:2354:x1875409158404352:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530031.361498:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530031.361507:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 16 pid: 14339 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361526:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 16 pid: 14339 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361554:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac43d1800/0xaa46022e3f18c698 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12cc expref: 16 pid: 14339 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361572:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788530031.361578:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361590:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361600:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.361635:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530031.361765:0:14340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.361774:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530031.362056:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788530031.362237:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788530031.362286:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788530031.362384:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14340:1875409185662336:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788530031.364198:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+18:2354:x1875409158404352:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2693us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.364216:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1788530031.369157:0:14340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530031.369225:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc353ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530031.371369:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185662336 00000100:00100000:3.0:1788530031.371461:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185662336 00000100:00100000:3.0:1788530031.371544:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530031.371559:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1875409185662336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788530031.371751:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1875409185662336:12345-0@lo:1000:mdt00_001.0 Request processed in 196us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530031.371761:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530031.371832:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caac6cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14340:1875409185662336:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788530031.381511:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788530031.382360:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf5865f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14340:1875409185662464:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788530031.382444:0:14340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530031.382542:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabc5dcb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788530031.383356:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185662464 00000100:00100000:0.0:1788530031.383368:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185662464 00000100:00100000:0.0:1788530031.383472:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530031.383485:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14340:x1875409185662464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788530031.384017:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14340:x1875409185662464:12345-0@lo:1000:mdt00_001.0 Request processed in 533us (1571us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788530031.384025:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530031.384375:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf5865f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14340:1875409185662464:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788530031.384428:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384439:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384446:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384452:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.384456:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384464:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384480:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:1.0:1788530031.384484:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530031.384489:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384495:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df800/0xaa46022e3f18c6c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384533:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384540:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384545:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384559:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f50c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.384562:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384568:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384576:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530031.384590:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530031.384599:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 18 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384610:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 18 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384852:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 18 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.384964:0:14340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50800/0xaa46022e3f18c62f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12b0 expref: 18 pid: 15957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.384978:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc250000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14340:1875409185662592:192.168.201.52@tcp:105: 00000100:00100000:1.0:1788530031.385116:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caac5d54e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530031.390884:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.391066:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc250000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14340:1875409185662592:192.168.201.52@tcp:105: 00010000:00010000:1.0:1788530031.391100:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391135:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8caac4f50c00/0xaa46022e3f18c628 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391180:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391196:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391261:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391273:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391280:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391286:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391291:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.391295:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391302:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391313:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530031.391315:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530031.391318:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391329:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391340:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391346:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391351:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391355:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61df600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1788530031.391358:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391363:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391370:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cabc3837400) 00010000:00010000:1.0:1788530031.391371:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530031.391374:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.391379:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabf61df600/0xaa46022e3f18c6c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.391702:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+18:14517:x1875409158404224:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 36100us (36420us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788530031.391714:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000020:00080000:1.0:1788530031.391731:0:14340:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788530031.391887:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788530031.391915:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530031.391951:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788530031.391958:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788530031.394679:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404480 00000100:00100000:3.0:1788530031.394699:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404480 00000100:00100000:1.0:1788530031.396152:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1788530031.396165:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+18:14515:x1875409158404480:12345-192.168.201.52@tcp:49:dd.0 00000100:00100000:1.0:1788530031.396322:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac49f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+18:14515:x1875409158404480:12345-192.168.201.52@tcp:49:dd.0 Request processed in 158us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.396329:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1788530031.419358:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.419489:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404736 00000100:00100000:1.0:1788530031.419504:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404736 00000100:00100000:1.0:1788530031.419596:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1788530031.419608:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+18:14517:x1875409158404736:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788530031.420710:0:14343:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788530031.423376:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788530031.423467:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423487:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423499:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423507:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423514:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423520:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.423568:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530031.423642:0:14327:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530031.423657:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.423669:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabcfc48a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:3.0:1788530031.423691:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.423720:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:14517:x1875409158404736:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 4109us (4373us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788530031.423732:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000020:00080000:1.0:1788530031.423739:0:14343:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788530031.425854:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.426115:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cabc3837e00) 00010000:00010000:3.0:1788530031.426119:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788530031.426128:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.426137:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cabcfc48a00/0xaa46022e3f18c6d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.426284:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530031.426288:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530031.426291:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530031.566435:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530031.679587:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.679742:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404864 00000100:00100000:3.0:1788530031.679756:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404864 00000100:00100000:3.0:1788530031.679861:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1788530031.679884:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+8:2356:x1875409158404864:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:3.0:1788530031.680057:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.680153:0:15027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 8 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.680175:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530031.680180:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530031.680185:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.680261:0:15027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 8 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.680283:0:15027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 8 pid: 15022 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530031.680301:0:15027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15027:1875409185662720:192.168.201.52@tcp:104: 00000100:00100000:3.0:1788530031.680727:0:15027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cabfdf3fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530031.695862:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1788530031.698601:0:15029:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530031.698625:0:15029:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788530031.699372:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530031.700702:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788530031.700737:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405120 00000100:00100000:2.0:1788530031.700749:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405120 00000100:00100000:2.0:1788530031.700820:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788530031.700827:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158404992 00000100:00100000:2.0:1788530031.700847:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158404992 00000100:00100000:1.0:1788530031.704462:0:15027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc720a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15027:1875409185662720:192.168.201.52@tcp:104: 00010000:00010000:1.0:1788530031.704505:0:15027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530031.704989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.705249:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405248 00000100:00100000:1.0:1788530031.705259:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405248 00010000:00010000:1.0:1788530031.705310:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 11 pid: 15022 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.705363:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1788530031.705376:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabcedac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+11:2354:x1875409158405248:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530031.705410:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530031.705439:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 11 pid: 15022 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.705459:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 11 pid: 15022 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.705512:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d47c790d/0xaa46022e3f18c6ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xbe0af1fb37da12da expref: 11 pid: 15022 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.705532:0:14326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530031.705537:0:14326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530031.705544:0:14326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.705557:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530031.705597:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530031.705670:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabcedac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:2354:x1875409158405248:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 295us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.705678:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00010000:00010000:0.0:1788530031.706389:0:15027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.706404:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530031.707678:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1788530031.707698:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf5867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:2357:x1875409158405120:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:3.0:1788530031.707750:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.707772:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530031.707776:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530031.707783:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530031.707797:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788530031.878838:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788530031.878862:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1788530031.879287:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788530031.879374:0:16574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788530031.879378:0:16574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788530030 -> 1788530031 00002000:00010000:2.0:1788530031.879381:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788530031.879584:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879599:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879610:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879619:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530031.879625:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879637:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879668:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.879677:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f6b4064/0xaa46022e3f18c6e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530031.879816:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf5867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:2357:x1875409158405120:12345-192.168.201.52@tcp:4:dd.0 Request processed in 172120us (183969us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788530031.879941:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1788530031.879986:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1788530031.880000:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:2356:x1875409158404992:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:2.0:1788530031.880038:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.880052:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530031.880058:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530031.880065:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.880079:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530031.913138:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.913193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.913228:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530031.913260:0:15029:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530031.913272:0:15029:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788530031.913416:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405376 00000100:00100000:1.0:1788530031.913428:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405376 00000100:00100000:1.0:1788530031.913496:0:15029:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530031.913503:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405632 00000100:00100000:1.0:1788530031.913506:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405632 00000100:00100000:1.0:1788530031.913519:0:15029:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530031.913524:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405504 00000100:00100000:1.0:1788530031.913537:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405504 00000100:00100000:0.0:1788530031.921036:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1788530031.921057:0:16575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+13:2356:x1875409158405376:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:0.0:1788530031.921107:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.921126:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530031.921131:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530031.921138:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530031.921155:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788530031.986925:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1788530031.987675:0:15027:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1788530031.987683:0:15027:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788530031.987706:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.987724:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.987734:0:15027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.987759:0:15027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac4f51c00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530031.987765:0:15027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.988283:0:15027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.988315:0:15027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.988324:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6419160/0xaa46022e3f18c6de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530031.988457:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+15:2356:x1875409158404864:12345-192.168.201.52@tcp:4:dd.0 Request processed in 308569us (308878us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788530031.988469:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1788530031.990475:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1788530031.990501:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+14:2357:x1875409158405632:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:2.0:1788530031.990723:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.990744:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530031.990750:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530031.990759:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530031.990861:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530032.134237:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788530032.134360:0:16574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1788530032.134366:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:0.0:1788530032.134398:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134414:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134450:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134458:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1a00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788530032.134465:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134476:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134506:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134515:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002500c29d/0xaa46022e3f18c6ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530032.134647:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+12:2356:x1875409158404992:12345-192.168.201.52@tcp:4:dd.0 Request processed in 254644us (435274us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788530032.134658:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1788530032.134700:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1788530032.134715:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+11:2356:x1875409158405504:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:0.0:1788530032.134757:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134772:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788530032.134783:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530032.134792:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.134806:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135309:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135321:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135329:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135336:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788530032.135340:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135349:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135363:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.135371:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c6f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530032.135426:0:16575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+11:2356:x1875409158405376:12345-192.168.201.52@tcp:4:dd.0 Request processed in 214375us (222301us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788530032.135434:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000001:00080000:1.0:1788530032.206847:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1788530032.211611:0:15027:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788530032.211643:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211659:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211668:0:15027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211676:0:15027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8caac43d1000 already unused, calling callback (ffffffffc1773660) 00010000:00010000:1.0:1788530032.211681:0:15027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211692:0:15027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211718:0:15027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530032.211728:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317cd482/0xaa46022e3f18c6fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530032.211882:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+9:2357:x1875409158405632:12345-192.168.201.52@tcp:4:dd.0 Request processed in 221384us (298680us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788530032.211940:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1788530032.213792:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530032.224752:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530032.224856:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530032.224913:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405760 00000100:00100000:0.0:1788530032.224925:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405760 00000100:00100000:0.0:1788530032.225003:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158405888 00000100:00100000:0.0:1788530032.225007:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158405888 00000100:00100000:0.0:1788530032.225040:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1788530032.225052:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:2355:x1875409158405760:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:0.0:1788530032.225098:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.225119:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530032.225125:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530032.225133:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.225150:0:15028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530032.225256:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1788530032.225264:0:16575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+10:2355:x1875409158405888:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:0.0:1788530032.225282:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.225305:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530032.225308:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530032.225313:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.225323:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530032.245237:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530032.245357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530032.245427:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185662848 00000100:00100000:1.0:1788530032.245438:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185662848 00000100:00100000:1.0:1788530032.245513:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530032.245525:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185662848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530032.245556:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69795840 pending 5111808 free 3859808256 avail 3852468224 00000100:00100000:1.0:1788530032.245605:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185662848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530032.245612:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788530032.245637:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530032.245698:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788530032.245705:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cabfc721c00, transno 8589934595 00000004:00080000:1.0:1788530032.245718:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788530032.245757:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185662848:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788530032.352506:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1788530032.354670:0:16574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1788530032.354682:0:16574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788530031 -> 1788530032 00002000:00010000:2.0:1788530032.354685:0:16574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788530030 -> 1788530032 00002000:00010000:2.0:1788530032.354687:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788530032.354707:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354724:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354735:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354743:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfc00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530032.354749:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354759:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354798:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.354822:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000639f0fd1/0xaa46022e3f18c701 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530032.355413:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+13:2356:x1875409158405504:12345-192.168.201.52@tcp:4:dd.0 Request processed in 220696us (442177us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788530032.355427:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000001:00080000:1.0:1788530032.415475:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:1.0:1788530032.415507:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1788530032.415616:0:15028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788530032.415641:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415657:0:15028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415668:0:15028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415676:0:15028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61dfe00 already unused, calling callback (ffffffffc1773660) 00010000:00010000:0.0:1788530032.415682:0:15028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415692:0:15028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415738:0:15028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530032.415747:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c03726/0xaa46022e3f18c708 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530032.415885:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+7:2355:x1875409158405760:12345-192.168.201.52@tcp:4:dd.0 Request processed in 190825us (191139us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788530032.415940:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00010000:00010000:2.0:1788530032.417064:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417082:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417092:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417100:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cabf61de600 already unused, calling callback (ffffffffc1773660) 00010000:00010000:2.0:1788530032.417105:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417114:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417134:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530032.417171:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b873e8/0xaa46022e3f18c70f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530032.417262:0:16575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158405888:12345-192.168.201.52@tcp:4:dd.0 Request processed in 191994us (192402us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788530032.417273:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00010000:00010000:2.0:1788530032.589665:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530033.421196:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788530033.421205:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530033.421238:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788530033.421243:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788530033.443355:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530033.443404:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530033.443440:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530033.443461:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530033.443478:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1788530033.443496:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1788530033.443616:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406016 00000100:00100000:0.0:1788530033.443627:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406016 00000100:00100000:0.0:1788530033.443701:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1788530033.443712:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158406016:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530033.443982:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16e6764e-3e4a-4f3b-bf29-56e72ac0c7c5+14:2355:x1875409158406016:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 271us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530033.443991:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1788530033.444166:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406528 00000100:00100000:0.0:1788530033.444171:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406528 00000100:00100000:0.0:1788530033.444209:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406144 00000100:00100000:0.0:1788530033.444212:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406144 00000100:00100000:0.0:1788530033.444231:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1788530033.444237:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158406528:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530033.444276:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+6:2355:x1875409158406528:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 39us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530033.444284:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1788530033.444312:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1788530033.444318:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:2355:x1875409158406144:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530033.444345:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+20:2355:x1875409158406144:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530033.444351:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00080000:0.0:1788530033.444373:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530033.445179:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406272 00000100:00100000:2.0:1788530033.445188:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406272 00000100:00100000:2.0:1788530033.445233:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406784 00000100:00100000:2.0:1788530033.445236:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406784 00000100:00100000:2.0:1788530033.445258:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1788530033.445263:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1788530033.445265:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158406272:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530033.445270:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158406784:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1788530033.445378:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158406784:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 107us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530033.445385:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1788530033.445402:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406400 00000100:00100000:0.0:1788530033.445405:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406400 00000100:00100000:0.0:1788530033.445422:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1788530033.445428:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158406400:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788530033.445590:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158406272:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 325us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530033.445597:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00080000:2.0:1788530033.445617:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530033.445620:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530033.451339:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1788530033.451396:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409158406656 00000100:00100000:2.0:1788530033.451407:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409158406656 00000100:00100000:2.0:1788530033.451507:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1788530033.451517:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158406656:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1788530033.451602:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ecd5e1f1-cff6-40b4-87fb-56a1379238b2+5:2355:x1875409158406656:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530033.451609:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00080000:3.0:1788530033.451948:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530033.454889:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf60e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caad2f09-bb44-4f05-bb45-30cb5e9cd0e9+5:2355:x1875409158406400:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 9446us (11378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530033.454921:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00010000:00010000:2.0:1788530033.613672:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530034.566478:0:16612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788530034.641000:0:14327:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530035.277631:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530035.277663:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabfc722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185662976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530035.277755:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.279118:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185662976 00000100:00100000:1.0:1788530035.279133:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185662976 00000100:00100000:1.0:1788530035.279230:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530035.279242:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185662976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530035.279293:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788530035.285467:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabfc723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875409185662976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6212us (7697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530035.285485:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530035.285594:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabfc722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875409185662976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530035.285746:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185663232:0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.285793:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.285826:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530035.285831:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185663360:0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.285857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.285890:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185663232 00000100:00100000:1.0:1788530035.285920:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185663232 00000100:00100000:1.0:1788530035.285978:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530035.285987:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185663232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.286032:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875409185663232:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530035.286039:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530035.286060:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185663488:0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.286086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.286116:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530035.286122:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf60e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185663104:0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.286174:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.286203:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cabf563c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185663616:0@lo:400:kworker.0 00000100:00100000:1.0:1788530035.286225:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530035.286257:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875409185663232:0@lo:400:kworker.0 00000100:00080000:2.0:1788530035.287172:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530035.287180:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530035.287270:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185663360 00000100:00100000:0.0:1788530035.287279:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185663360 00000100:00100000:0.0:1788530035.287342:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185663488 00000100:00100000:0.0:1788530035.287346:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185663488 00000100:00100000:0.0:1788530035.287375:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185663616 00000100:00100000:0.0:1788530035.287378:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185663616 00000100:00100000:0.0:1788530035.287395:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530035.287415:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185663360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287493:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875409185663360:12345-0@lo:400:kworker.0 Request processed in 80us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530035.287501:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530035.287520:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530035.287525:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185663488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287557:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875409185663488:12345-0@lo:400:kworker.0 Request processed in 32us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530035.287563:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530035.287574:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530035.287580:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cabf563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185663616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287606:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cabf563ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875409185663616:12345-0@lo:400:kworker.0 Request processed in 26us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530035.287612:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530035.287635:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409185663104 00000100:00100000:0.0:1788530035.287639:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409185663104 00000100:00100000:0.0:1788530035.287663:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788530035.287670:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3302:x1875409185663104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287703:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8caac65cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:686d56f3-22b3-4cb4-96c8-2243e37ce242+23:3302:x1875409185663104:12345-0@lo:400:kworker.0 Request processed in 34us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530035.287710:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788530035.287773:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875409185663360:0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287806:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf60e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:686d56f3-22b3-4cb4-96c8-2243e37ce242:3302:1875409185663104:0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287833:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875409185663616:0@lo:400:kworker.0 00000100:00100000:0.0:1788530035.287857:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cabf563f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875409185663488:0@lo:400:kworker.0 00000100:00080000:3.0:1788530035.288323:0:14335:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788530035.661759:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 32127 lines, 32127 kept, 0 dropped, 0 bad.